Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: VR Co-Lab: A Virtual Reality Platform for Human–Robot Disassembly Training and Synthetic Data Generation
This research introduces a virtual reality (VR) training system for improving human–robot collaboration (HRC) in industrial disassembly tasks, particularly for e-waste recycling. Conventional training approaches frequently fail to provide sufficient adaptability, immediate feedback, or scalable solutions for complex industrial workflows. The implementation leverages Quest Pro’s body-tracking capabilities to enable ergonomic, immersive interactions with planned eye-tracking integration for improved interactivity and accuracy. The Niryo One robot aids users in hands-on disassembly while generating synthetic data to refine robot motion planning models. A Robot Operating System (ROS) bridge enables the seamless simulation and control of various robotic platforms using Unified Robotics Description Format (URDF) files, bridging virtual and physical training environments. A Long Short-Term Memory (LSTM) model predicts user interactions and robotic motions, optimizing trajectory planning and minimizing errors. Monte Carlo dropout-based uncertainty estimation enhances prediction reliability, ensuring adaptability to dynamic user behavior. Initial technical validation demonstrates the platform’s potential, with preliminary testing showing promising results in task execution efficiency and human–robot motion alignment, though comprehensive user studies remain for future work. Limitations include the lack of multi-user scenarios, potential tracking inaccuracies, and the need for further real-world validation. This system establishes a sandbox training framework for HRC in disassembly, leveraging VR and AI-driven feedback to improve skill acquisition, task efficiency, and training scalability across industrial applications.  more » « less
Award ID(s):
2506209
PAR ID:
10686949
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
MDPI
Date Published:
Journal Name:
Machines
Volume:
13
Issue:
3
ISSN:
2075-1702
Page Range / eLocation ID:
239
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; (, Construction Robotics)
    Abstract Robotic automation in construction has created the need for new competencies that will enable the workforce to engage with robots safely and effectively. However, differing perceptions between industry professionals and academia make aligning academic programs with industry needs challenging. This study evaluates these perceptions to guide the design of HRC training programs. A three-round Delphi study was conducted separately with panels of industry professionals and academic experts to assess their views on HRC competencies in construction. The findings revealed that both panels identified human–robot interfaces, HRC safety and standards, robot control systems, and construction robot applications as the top five HRC knowledge areas. Industry professionals also emphasized task planning knowledge, while academic experts focused on HRC ethics. Key HRC skills include effective communication, safety management, technical proficiency, and compliance with regulations and standards, with industry professionals prioritizing proficiency in task planning and academics emphasizing human–robot interface proficiency. Both expert panels prioritized teamwork, continuous learning, problem-solving, communication, and adaptability as top-rated HRC abilities. This study contributes to knowledge by defining key HRC competencies and identifying differences in priorities between industry and academia. These insights can guide the development of academic curricula that better align with industry needs, supporting the creation of training programs that equip the workforce with the competencies required for safe and effective robotic collaboration. The study also promotes collaboration between industry and academia, fostering innovation in HRC and robotics in construction. Future research directions are proposed to explore innovative training methods to equip the future workforce with HRC competencies. 
    more » « less
  2. ; ; ; (, Proceedings of the ASME 2024 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE2024, August 25–28, 2024, Washington, DC, USA.)
    Product disassembly is essential for remanufacturing operations and recovery of end-of-use devices. However, disassembly has often been performed manually with significant safety issues for human workers. Recently, human-robot collaboration has become popular to reduce the human workload and handle hazardous materials. However, due to the current limitations of robots, they are not fully capable of performing every disassembly task. It is critical to determine whether a robot can accomplish a specific disassembly task. This study develops a disassembly score which represents how easy is to disassemble a component by robots, considering the attributes of the component along with the robotic capability. Five factors, including component weight, shape, size, accessibility, and positioning, are considered when developing the disassembly score. Further, the relationship between the five factors and robotic capabilities, such as grabbing and placing, is discussed. The MaxViT (Multi-Axis Vision Transformer) model is used to determine component sizes through image processing of the XPS 8700 desktop, demonstrating the potential for automating disassembly score generation. Moreover, the proposed disassembly score is discussed in terms of determining the appropriate work setting for disassembly operations, under three main categories: human-robot collaboration (HRC), semi-HRC, and worker-only settings. A framework for calculating disassembly time, considering human-robot collaboration, is also proposed. 
    more » « less
  3. ; ; ; (, Proceedings of the ASME 2020 International Mechanical Engineering Congress and Exposition (IMECE 2020))
    Abstract With the development of industrial automation and artificial intelligence, robotic systems are developing into an essential part of factory production, and the human-robot collaboration (HRC) becomes a new trend in the industrial field. In our previous work, ten dynamic gestures have been designed for communication between a human worker and a robot in manufacturing scenarios, and a dynamic gesture recognition model based on Convolutional Neural Networks (CNN) has been developed. Based on the model, this study aims to design and develop a new real-time HRC system based on multi-threading method and the CNN. This system enables the real-time interaction between a human worker and a robotic arm based on dynamic gestures. Firstly, a multi-threading architecture is constructed for high-speed operation and fast response while schedule more than one task at the same time. Next, A real-time dynamic gesture recognition algorithm is developed, where a human worker’s behavior and motion are continuously monitored and captured, and motion history images (MHIs) are generated in real-time. The generation of the MHIs and their identification using the classification model are synchronously accomplished. If a designated dynamic gesture is detected, it is immediately transmitted to the robotic arm to conduct a real-time response. A Graphic User Interface (GUI) for the integration of the proposed HRC system is developed for the visualization of the real-time motion history and classification results of the gesture identification. A series of actual collaboration experiments are carried out between a human worker and a six-degree-of-freedom (6 DOF) Comau industrial robot, and the experimental results show the feasibility and robustness of the proposed system. 
    more » « less
  4. ; ; ; (, Journal of Mechanical Design)
    Product disassembly is integral to remanufacturing and recovery operations of end-of-use devices. Traditionally, disassembly has been conducted manually with significant safety risks to human workers. In recent years, robotic disassembly has gained popularity to alleviate human workload and safety concerns. Despite these advancements, robots have limited capabilities in handling all disassembly tasks independently. It is essential to assess whether a robot is capable of performing specific disassembly tasks or not. This study proposes a disassembly scoring framework that evaluates robotic feasibility for disassembling components based on five design-related factors: weight, shape, size, accessibility, and positioning. For each factor, a disassembly score is defined to analyze its specific impact on robotic grasping and placement capabilities. Further, the relationship between the five factors and robotic capabilities, such as grasping and placing, is discussed by an example of the UR5e manipulator. To show the potential for automating the generation of disassembly metric, the Multi-Axis Vision Transformer (MaxViT) model is used to determine component sizes through image processing of the XPS 8700 desktop. Moreover, the application of the proposed disassembly scoring framework is discussed in terms of determining the appropriate work setting for disassembly operations under three main categories: human–robot collaboration (HRC), Semi-HRC, and Worker-Only settings. A disassembly time metric for calculating disassembly time for HRC is also proposed. The study outcomes determine the proper work settings based on the robotic capability. 
    more » « less
  5. ; ; ; (, Robotics and computerintegrated manufacturing)
    This paper presents a comprehensive disassembly sequence planning (DSP) algorithm in the human–robot collaboration (HRC) setting with consideration of several important factors including limited resources and human workers’ safety. The proposed DSP algorithm is capable of planning and distributing disassembly tasks among the human operator, the robot, and HRC, aiming to minimize the total disassembly time without violating resources and safety constraints. Regarding the resource constraints, we consider one human operator and one robot, and a limited quantity of disassembly tools. Regarding the safety constraints, we consider avoiding potential human injuries from to-be-disassembled components and possible collisions between the human operator and the robot due to the short distance between disassembly tasks. In addition, the transitions for tool changing, the moving between disassembly modules, and the precedence constraint of components to be disassembled are also considered and formulated as constraints in the problem formulation. Both numerical and experimental studies on the disassembly of a used hard disk drive (HDD) have been conducted to validate the proposed algorithm. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Text Encoded Conversion
  • XML
  • Save / Share this Record
  • Send to Email