skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Designing An Augmented Reality Based Interface For Wearable Exoskeletons
Full-body, powered wearable exoskeletons combine the capabilities of machines and humans to maximize productivity. Powered exoskeletons can ease industrial workers in manipulating heavy loads in a manner that is difficult to automate. However, introduction of exoskeletons may result in unexpected work hazards, due to the mismatch between user-intended and executed actions thereby creating difficulties in sensing the physical operational envelope, need for increased clearance, and maneuverability limitations. To control such hazards, this paper presents a rearview human localization augmented reality (AR) platform to enhance spatial awareness of people behind the exoskeleton users. This platform leverages a computer vision algorithm called Monocular 3D Pedestrian Localization and Uncertainty Estimation (MonoLoco) for identifying humans and estimating their distance from a video camera feed and off-the-shelf AR goggles for visualizing the surrounding. Augmenting rear view awareness of humans can help exoskeleton users to avoid accidental collisions that can lead to severe injuries.  more » « less
Award ID(s):
1839946
PAR ID:
10352729
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Volume:
64
Issue:
1
ISSN:
2169-5067
Page Range / eLocation ID:
38 to 41
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The mental demands associated with operating complex whole-body powered exoskeletons are poorly understood. This study aimed to explore the overall workload associated with using a powered wholebody exoskeleton among expert and novice users, as well as the changes in workload resulting from novices adapting to exoskeleton-use over time. We used eye-tracking measures to quantify the differences in workload of six novices and five experts while they performed a levelwalking task, with and without wearing a whole-body powered exoskeleton. We found that only novices’ pupil dilation (PD) increased, while experts showed a greater proportion of downward-directed pathfixations (PF) compared to novices while wearing the exoskeleton. These results indicate that novices’ mental demands were higher, and that experts and novices exhibited distinct visuomotor strategies. Eyetracking measures may potentially be used to detect differences in workload and skill-level associated with using exoskeletons, and also considered as inputs for future adaptive exoskeleton control algorithms. 
    more » « less
  2. null (Ed.)
    Powered ankle exoskeletons that apply assistive torques with optimized timing and magnitude can reduce metabolic cost by ∼10% compared to normal walking. However, finding individualized optimal control parameters is time consuming and must be done independently for different walking modes (e.g., speeds, slopes). Thus, there is a need for exoskeleton controllers that are capable of continuously adapting torque assistance in concert with changing locomotor demands. One option is to use a biologically inspired, model-based control scheme that can capture the adaptive behavior of the human plantarflexors during natural gait. Here, based on previously demonstrated success in a powered ankle-foot prosthesis, we developed an ankle exoskeleton controller that uses a neuromuscular model (NMM) comprised of a Hill type musculotendon driven by a simple positive force feedback reflex loop. To examine the effects of NMM reflex parameter settings on (i) ankle exoskeleton mechanical performance and (ii) users’ physiological response, we recruited nine healthy, young adults to walk on a treadmill at a fixed speed of 1.25 m/s while donning bilateral tethered robotic ankle exoskeletons. To quantify exoskeleton mechanics, we measured exoskeleton torque and power output across a range of NMM controller Gain (0.8–2.0) and Delay (10–40 ms) settings, as well as a High Gain/High Delay (2.0/40 ms) combination. To quantify users’ physiological response, we compared joint kinematics and kinetics, ankle muscle electromyography and metabolic rate between powered and unpowered/zero-torque conditions. Increasing NMM controller reflex Gain caused increases in average ankle exoskeleton torque and net power output, while increasing NMM controller reflex Delay caused a decrease in net ankle exoskeleton power output. Despite systematic reduction in users’ average biological ankle moment with exoskeleton mechanical assistance, we found no NMM controller Gain or Delay settings that yielded changes in metabolic rate. Post hoc analyses revealed weak association at best between exoskeleton and biological mechanics and changes in users’ metabolic rate. Instead, changes in users’ summed ankle joint muscle activity with powered assistance correlated with changes in their metabolic energy use, highlighting the potential to utilize muscle electromyography as a target for on-line optimization in next generation adaptive exoskeleton controllers. 
    more » « less
  3. Exoskeletons are an emerging form of technology that combines the skills of both machines and humans to give wearers the ability to complete physically demanding tasks that would be too strenuous for most humans. Exoskeleton adoption has the potential to both enhance and disrupt many aspects of work, including power dynamics in the workplace and the human-machine interactions that take place. Dyadic Power Theory (DPT) is a useful theory for exploring the impacts of exoskeleton adoption. In this conceptual paper, we extend DPT to relationships between humans and machines in organizations, as well as human-human communication where use of an exoskeleton has resulted in shifts of power. 
    more » « less
  4. Abstract Powered exoskeletons need actuators that are lightweight, compact, and efficient while allowing for accurate torque control. To satisfy these requirements, researchers have proposed using series elastic actuators (SEAs). SEAs use a spring in series with rotary or linear actuators. The spring compliance, in conjunction with an appropriate control scheme, improves torque control, efficiency, output impedance, and disturbance rejection. However, springs add weight to the actuator and complexity to the control, which may have negative effects on the performance of the powered exoskeleton. Therefore, there is an unmet need for new SEA designs that are lighter and more efficient than available systems, as well as for control strategies that push the performance of SEA-based exoskeletons without requiring complex modeling and tuning. This article presents the design, development, and testing of a novel SEA with high force density for powered exoskeletons, as well as the use of a two degree-of-freedom (2DOF) PID system to improve output impedance and disturbance rejection. Benchtop testing results show reduced output impedance and damping values when using a 2DOF PID controller as compared to a 1DOF PID controller. Human experiments with three able-bodied subjects (N = 3) show improved torque tracking with reduced root-mean-square error by 45.2% and reduced peak error by 49.8% when using a 2DOF PID controller. Furthermore, EMG data shows a reduction in peak EMG value when using the exoskeleton in assistive mode compared to the exoskeleton operating in transparent mode. 
    more » « less
  5. Powered knee exoskeletons have shown potential for mobility restoration and power augmentation. However, the benefits of exoskeletons are partially offset by some design challenges that still limit their positive effects on people. Among them, joint misalignment is a critical aspect mostly because the human knee joint movement is not a fixed-axis rotation. In addition, remarkable mass and stiffness are also limitations. Aiming to minimize joint misalignment, this paper proposes a bio-inspired knee exoskeleton with a joint design that mimics the human knee joint. Moreover, to accomplish a lightweight and high compliance design, a high stiffness cable-tension amplification mechanism is leveraged. Simulation results indicate our design can reduce 49.3 and 71.9% maximum total misalignment for walking and deep squatting activities, respectively. Experiments indicate that the exoskeleton has high compliance (0.4 and 0.1 Nm backdrive torque under unpowered and zero-torque modes, respectively), high control bandwidth (44 Hz), and high control accuracy (1.1 Nm root mean square tracking error, corresponding to 7.3% of the peak torque). This work demonstrates performance improvement compared with state-of-the-art exoskeletons. 
    more » « less