skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


This content will become publicly available on December 1, 2025

Title: Intelligent ergonomic optimization in bimanual worker-robot interaction: A Reinforcement Learning approach
Robots have the potential to enhance safety on construction job sites by assuming hazardous tasks. While existing safety research on physical human-robot interaction (pHRI) primarily addresses collision risks, ensuring inherently safe collaborative workflows is equally important. For example, ergonomic optimization in co-manipulation is an important safety consideration in pHRI. While frameworks such as Rapid Entire Body Assessment (REBA) have been an industry standard for these interventions, their lack of a rigorous mathematical structure poses challenges for using them with optimization algorithms. Previous works have tackled this gap by developing approximations or statistical approaches that are error-prone or data-dependent. This paper presents a framework using Reinforcement Learning for precise ergonomic optimization that generalizes to different types of tasks. To ensure practicality and safe experimentations, the training leverages Inverse Kinematics in virtual reality to simulate human movement mechanics. Results of a comparison between the developed framework and ergonomically naive approaches are presented.  more » « less
Award ID(s):
2047138
PAR ID:
10617085
Author(s) / Creator(s):
;
Publisher / Repository:
Elsevier - Automation in Construction
Date Published:
Journal Name:
Automation in Construction
Volume:
168
Issue:
PA
ISSN:
0926-5805
Page Range / eLocation ID:
105741
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Measurement of interaction forces distributed across the attachment interface in wearable devices is critical for understanding ergonomic physical human–robot interaction (pHRI). The main challenges in sensorization of pHRI interfaces are (i) capturing the fine nature of force transmission from compliant human tissue onto rigid surfaces in the wearable device and (ii) utilizing a low-cost and easily implementable design that can be adapted for a variety of human interfaces. This paper addresses both challenges and presents a modular sensing panel that uses force-sensing resistors (FSRs) combined with robust electrical and mechanical integration principles that result in a reliable solution for distributed load measurement. The design is demonstrated through an upper-arm cuff, which uses 24 sensing panels, in conjunction with the Harmony exoskeleton. Validation of the design with controlled loading of the sensorized cuff proves the viability of FSRs in an interface sensing solution. Preliminary experiments with a human subject highlight the value of distributed interface force measurement in recognizing the factors that influence ergonomic pHRI and elucidating their effects. The modular design and low cost of the sensing panel lend themselves to extension of this approach for studying ergonomics in a variety of wearable applications with the goal of achieving safe, comfortable, and effective human–robot interaction. 
    more » « less
  2. Ferretti, Gianni (Ed.)
    Many anticipated physical human-robot interaction (pHRI) applications in the near future are overground tasks such as walking assistance. For investigating the biomechanics of human movement during pHRI, this work presents Ophrie, a novel interactive robot dedicated for physical interaction tasks with a human in overground settings. Unique design requirements for pHRI were considered in implementing the one-arm mobile robot, such as the low output impedance and the ability to apply small interaction forces. The robot can measure the human arm stiffness, an important physical quantity that can reveal human biomechanics during overground pHRI, while the human walks alongside the robot. This robot is anticipated to enable novel pHRI experiments and advance our understanding of intuitive and effective overground pHRI. 
    more » « less
  3. Abstract In this paper, we study the effects of mechanical compliance on safety in physical human–robot interaction (pHRI). More specifically, we compare the effect of joint compliance and link compliance on the impact force assuming a contact occurred between a robot and a human head. We first establish pHRI system models that are composed of robot dynamics, an impact contact model, and head dynamics. These models are validated by Simscape simulation. By comparing impact results with a robotic arm made of a compliant link (CL) and compliant joint (CJ), we conclude that the CL design produces a smaller maximum impact force given the same lateral stiffness as well as other physical and geometric parameters. Furthermore, we compare the variable stiffness joint (VSJ) with the variable stiffness link (VSL) for various actuation parameters and design parameters. While decreasing stiffness of CJs cannot effectively reduce the maximum impact force, CL design is more effective in reducing impact force by varying the link stiffness. We conclude that the CL design potentially outperforms the CJ design in addressing safety in pHRI and can be used as a promising alternative solution to address the safety constraints in pHRI. 
    more » « less
  4. Navigation safety is critical for many autonomous systems such as self-driving vehicles in an urban environment. It requires an explicit consideration of boundary constraints that describe the borders of any infeasible, non-navigable, or unsafe regions. We propose a principled boundary-aware safe stochastic planning framework with promising results. Our method generates a value function that can strictly distinguish the state values between free (safe) and non-navigable (boundary) spaces in the continuous state, naturally leading to a safe boundary-aware policy. At the core of our solution lies a seamless integration of finite elements and kernel-based functions, where the finite elements allow us to characterize safety-critical states’ borders accurately, and the kernel-based function speeds up computation for the non-safety-critical states. The proposed method was evaluated through extensive simulations and demonstrated safe navigation behaviors in mobile navigation tasks. Additionally, we demonstrate that our approach can maneuver safely and efficiently in cluttered real-world environments using a ground vehicle with strong external disturbances, such as navigating on a slippery floor and against external human intervention. 
    more » « less
  5. Human operators of remote and semi-autonomous systems must have a high level of executive function to safely and efficiently conduct operations. These operators face unique cognitive challenges when monitoring and controlling robotic machines, such as vehicles, drones, and construction equipment. The development of safe and experienced human operators of remote machines requires structured training and credentialing programs. This review critically evaluates the potential for incorporating neurotechnology into remote systems operator training and work to enhance human-machine interactions, performance, and safety. Recent evidence demonstrating that different noninvasive neuromodulation and neurofeedback methods can improve critical executive functions such as attention, learning, memory, and cognitive control is reviewed. We further describe how these approaches can be used to improve training outcomes, as well as teleoperator vigilance and decision-making. We also describe how neuromodulation can help remote operators during complex or high-risk tasks by mitigating impulsive decision-making and cognitive errors. While our review advocates for incorporating neurotechnology into remote operator training programs, continued research is required to evaluate the how these approaches will impact industrial safety and workforce readiness. 
    more » « less