skip to main content


Title: Shared Control Decreases the Physical and Cognitive Demands of Maintaining a Secure Grip
Upper-limb amputees commonly cite difficulty of control as one of the main reasons why they abandon their prostheses. Combining myoelectric control with autonomous sensor-based control could improve prosthesis control. However, the cognitive and physical impact of shared control and semi-autonomous systems on users has yet to be fully explored. In this study we introduce a novel shared-control algorithm that blends proportional position control predicted from electromyography (EMG) with proportional position control predicted from an autonomous machine using infrared sensors embedded in the prosthetic hand’s fingers to detect the distance to objects. The user’s EMG control is damped in proportion to the machine’s prediction of an object’s position in relation to a given finger. The shared-control algorithm was validated using three intact individuals completing a holding task where they attempted to hold an object for as long as possible without dropping it. Shared control resulted in fewer object drops, 32% less cognitive demand, and 49% less physical effort (measured by EMG) relative to the participant’s EMG control alone. These results indicate that shared control can reduce the physiological burdens on the user as well as increase prosthetic control.  more » « less
Award ID(s):
1901492
NSF-PAR ID:
10351635
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Proceedngs of the Myoelectric Controls and Upper Limb Prosthetics Symposium
Page Range / eLocation ID:
82-85
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Upper-limb amputees commonly cite difficulty of control as one of the main reasons why they abandon their prostheses. Combining myoelectric control with autonomous sensor-based control could improve prosthesis control. However, the cognitive and physical impact of shared control and semi-autonomous systems on users has yet to be fully explored. In this study we introduce a novel shared-control algorithm that blends proportional position control predicted from electromyography (EMG) with proportional position control predicted from an autonomous machine using infrared sensors embedded in the prosthetic hand’s fingers to detect the distance to objects. The user’s EMG control is damped in proportion to the machine’s prediction of an object’s position in relation to a given finger. The shared-control algorithm was validated using three intact individuals completing a holding task where they attempted to hold an object for as long as possible without dropping it. Shared control resulted in fewer object drops, 32% less cognitive demand, and 49% less physical effort (measured by EMG) relative to the participant’s EMG control alone. These results indicate that shared control can reduce the physiological burdens on the user as well as increase prosthetic control. 
    more » « less
  2. Tele-nursing robots provide a safe approach for patient-caring in quarantine areas. For effective nurse-robot collaboration, ergonomic teleoperation and intuitive interfaces with low physical and cognitive workload must be developed. We propose a framework to evaluate the control interfaces to iteratively develop an intuitive, efficient, and ergonomic teleoperation interface. The framework is a hierarchical procedure that incorporates general to specific assessment and its role in design evolution. We first present pre-defined objective and subjective metrics used to evaluate three representative contemporary teleoperation interfaces. The results indicate that teleoperation via human motion mapping outperforms the gamepad and stylus interfaces. The trade-off with using motion mapping as a teleoperation interface is the non-trivial physical fatigue. To understand the impact of heavy physical demand during motion mapping teleoperation, we propose an objective assessment of physical workload in teleoperation using electromyography (EMG). We find that physical fatigue happens in the actions that involve precise manipulation and steady posture maintenance. We further implemented teleoperation assistance in the form of shared autonomy to eliminate the fatigue-causing component in robot teleoperation via motion mapping. The experimental results show that the autonomous feature effectively reduces the physical effort while improving the efficiency and accuracy of the teleoperation interface. 
    more » « less
  3. null (Ed.)
    Abstract Despite the promise of powered lower limb prostheses, existing controllers do not assist many daily activities that require continuous control of prosthetic joints according to human states and environments. The objective of this case study was to investigate the feasibility of direct, continuous electromyographic (dEMG) control of a powered ankle prosthesis, combined with physical therapist-guided training, for improved standing postural control in an individual with transtibial amputation. Specifically, EMG signals of the residual antagonistic muscles (i.e. lateral gastrocnemius and tibialis anterior) were used to proportionally drive pneumatical artificial muscles to move a prosthetic ankle. Clinical-based activities were used in the training and evaluation protocol of the control paradigm. We quantified the EMG signals in the bilateral shank muscles as well as measures of postural control and stability. Compared to the participant’s daily passive prosthesis, the dEMG-controlled ankle, combined with the training, yielded improved clinical balance scores and reduced compensation from intact joints. Cross-correlation coefficient of bilateral center of pressure excursions, a metric for quantifying standing postural control, increased to .83(±.07) when using dEMG ankle control ( passive device: .39(±.29)) . We observed synchronized activation of homologous muscles, rapid improvement in performance on the first day of the training for load transfer tasks, and further improvement in performance across training days (p = .006). This case study showed the feasibility of this dEMG control paradigm of a powered prosthetic ankle to assist postural control. This study lays the foundation for future study to extend these results through the inclusion of more participants and activities. 
    more » « less
  4. null (Ed.)
    The Georgia Tech Miniature Autonomous Blimp (GT-MAB) needs localization algorithms to navigate to way-points in an indoor environment without leveraging an external motion capture system. Indoor aerial robots often require a motion capture system for localization or employ simultaneous localization and mapping (SLAM) algorithms for navigation. The proposed strategy for GT-MAB localization can be accomplished using lightweight sensors on a weight-constrained platform like the GT-MAB. We train an end-to-end convolutional neural network (CNN) that predicts the horizontal position and heading of the GT-MAB using video collected by an onboard monocular RGB camera. On the other hand, the height of the GT-MAB is estimated from measurements through a time-of-flight (ToF) single-beam laser sensor. The monocular camera and the single-beam laser sensor are sufficient for the localization algorithm to localize the GT-MAB in real time, achieving the averaged 3D positioning errors to be less than 20 cm, and the averaged heading errors to be less than 3 degrees. With the accuracy of our proposed localization method, we are able to use simple proportional-integral-derivative controllers to control the GT-MAB for waypoint navigation. Experimental results on the waypoint following are provided, which demonstrates the use of a CNN as the primary localization method for estimating the pose of an indoor robot that successfully enables navigation to specified waypoints. 
    more » « less
  5. This paper presents design and control innovations of wearable robots that tackle two barriers to widespread adoption of powered exoskeletons, namely restriction of human movement and versatile control of wearable co-robot systems. First, the proposed quasi-direct drive actuation comprising of our customized high-torque density motors and low ratio transmission mechanism significantly reduces the mass of the robot and produces high backdrivability. Second, we derive a biomechanics model-based control that generates biological torque profile for versatile control of both squat and stoop lifting assistance. The control algorithm detects lifting postures using compact inertial measurement unit (IMU) sensors to generate an assistive profile that is proportional to the biological torque produced from our model. Experimental results demonstrate that the robot exhibits low mechanical impedance (1.5 Nm resistive torque) when it is unpowered and 0.5 Nm resistive torque with zero-torque tracking control. Root mean square (RMS) error of torque tracking is less than 0.29 Nm (1.21% error of 24 Nm peak torque). Compared with squatting without the exoskeleton, the controller reduces 87.5%, 80% and 75% of the of three knee extensor muscles (average peak EMG of 3 healthy subjects) during squat with 50% of biological torque assistance. 
    more » « less