skip to main content


Title: Haptic shared control improves neural efficiency during myoelectric prosthesis use
Abstract

Clinical myoelectric prostheses lack the sensory feedback and sufficient dexterity required to complete activities of daily living efficiently and accurately. Providing haptic feedback of relevant environmental cues to the user or imbuing the prosthesis with autonomous control authority have been separately shown to improve prosthesis utility. Few studies, however, have investigated the effect of combining these two approaches in a shared control paradigm, and none have evaluated such an approach from the perspective of neural efficiency (the relationship between task performance and mental effort measured directly from the brain). In this work, we analyzed the neural efficiency of 30 non-amputee participants in a grasp-and-lift task of a brittle object. Here, a myoelectric prosthesis featuring vibrotactile feedback of grip force and autonomous control of grasping was compared with a standard myoelectric prosthesis with and without vibrotactile feedback. As a measure of mental effort, we captured the prefrontal cortex activity changes using functional near infrared spectroscopy during the experiment. It was expected that the prosthesis with haptic shared control would improve both task performance and mental effort compared to the standard prosthesis. Results showed that only the haptic shared control system enabled users to achieve high neural efficiency, and that vibrotactile feedback was important for grasping with the appropriate grip force. These results indicate that the haptic shared control system synergistically combines the benefits of haptic feedback and autonomous controllers, and is well-poised to inform such hybrid advancements in myoelectric prosthesis technology.

 
more » « less
NSF-PAR ID:
10390549
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
Scientific Reports
Volume:
13
Issue:
1
ISSN:
2045-2322
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Upper-limb amputees commonly cite difficulty of control as one of the main reasons why they abandon their prostheses. Combining myoelectric control with autonomous sensor-based control could improve prosthesis control. However, the cognitive and physical impact of shared control and semi-autonomous systems on users has yet to be fully explored. In this study we introduce a novel shared-control algorithm that blends proportional position control predicted from electromyography (EMG) with proportional position control predicted from an autonomous machine using infrared sensors embedded in the prosthetic hand’s fingers to detect the distance to objects. The user’s EMG control is damped in proportion to the machine’s prediction of an object’s position in relation to a given finger. The shared-control algorithm was validated using three intact individuals completing a holding task where they attempted to hold an object for as long as possible without dropping it. Shared control resulted in fewer object drops, 32% less cognitive demand, and 49% less physical effort (measured by EMG) relative to the participant’s EMG control alone. These results indicate that shared control can reduce the physiological burdens on the user as well as increase prosthetic control. 
    more » « less
  2. Upper-limb amputees commonly cite difficulty of control as one of the main reasons why they abandon their prostheses. Combining myoelectric control with autonomous sensor-based control could improve prosthesis control. However, the cognitive and physical impact of shared control and semi-autonomous systems on users has yet to be fully explored. In this study we introduce a novel shared-control algorithm that blends proportional position control predicted from electromyography (EMG) with proportional position control predicted from an autonomous machine using infrared sensors embedded in the prosthetic hand’s fingers to detect the distance to objects. The user’s EMG control is damped in proportion to the machine’s prediction of an object’s position in relation to a given finger. The shared-control algorithm was validated using three intact individuals completing a holding task where they attempted to hold an object for as long as possible without dropping it. Shared control resulted in fewer object drops, 32% less cognitive demand, and 49% less physical effort (measured by EMG) relative to the participant’s EMG control alone. These results indicate that shared control can reduce the physiological burdens on the user as well as increase prosthetic control. 
    more » « less
  3. Abstract Background

    Myoelectric prostheses are a popular choice for restoring motor capability following the loss of a limb, but they do not provide direct feedback to the user about the movements of the device—in other words, kinesthesia. The outcomes of studies providing artificial sensory feedback are often influenced by the availability of incidental feedback. When subjects are blindfolded and disconnected from the prosthesis, artificial sensory feedback consistently improves control; however, when subjects wear a prosthesis and can see the task, benefits often deteriorate or become inconsistent. We theorize that providing artificial sensory feedback about prosthesis speed, which cannot be precisely estimated via vision, will improve the learning and control of a myoelectric prosthesis.

    Methods

    In this study, we test a joint-speed feedback system with six transradial amputee subjects to evaluate how it affects myoelectric control and adaptation behavior during a virtual reaching task.

    Results

    Our results showed that joint-speed feedback lowered reaching errors and compensatory movements during steady-state reaches. However, the same feedback provided no improvement when control was perturbed.

    Conclusions

    These outcomes suggest that the benefit of joint speed feedback may be dependent on the complexity of the myoelectric control and the context of the task.

     
    more » « less
  4. Objective

    This study examined the interaction of gait-synchronized vibrotactile cues with an active ankle exoskeleton that provides plantarflexion assistance.

    Background

    An exoskeleton that augments gait may support collaboration through feedback to the user about the state of the exoskeleton or characteristics of the task.

    Methods

    Participants ( N = 16) were provided combinations of torque assistance and vibrotactile cues at pre-specified time points in late swing and early stance while walking on a self-paced treadmill. Participants were either given explicit instructions ( N = 8) or were allowed to freely interpret (N=8) how to coordinate with cues.

    Results

    For the free interpretation group, the data support an 8% increase in stride length and 14% increase in speed with exoskeleton torque across cue timing, as well as a 5% increase in stride length and 7% increase in speed with only vibrotactile cues. When given explicit instructions, participants modulated speed according to cue timing—increasing speed by 17% at cues in late swing and decreasing speed 11% at cues in early stance compared to no cue when exoskeleton torque was off. When torque was on, participants with explicit instructions had reduced changes in speed.

    Conclusion

    These findings support that the presence of torque mitigates how cues were used and highlights the importance of explicit instructions for haptic cuing. Interpreting cues while walking with an exoskeleton may increase cognitive load, influencing overall human-exoskeleton performance for novice users.

    Application

    Interactions between haptic feedback and exoskeleton use during gait can inform future feedback designs to support coordination between users and exoskeletons.

     
    more » « less
  5. Smooth camber morphing aircraft offer increased control authority and improved aerodynamic efficiency. Smart material actuators have become a popular driving force for shape changes, capable of adhering to weight and size constraints and allowing for simplicity in mechanical design. As a step towards creating uncrewed aerial vehicles (UAVs) capable of autonomously responding to flow conditions, this work examines a multifunctional morphing airfoil’s ability to follow commands in various flows. We integrated an airfoil with a morphing trailing edge consisting of an antagonistic pair of macro fiber composites (MFCs), serving as both skin and actuator, and internal piezoelectric flex sensors to form a closed loop composite system. Closed loop feedback control is necessary to accurately follow deflection commands due to the hysteretic behavior of MFCs. Here we used a deep reinforcement learning algorithm, Proximal Policy Optimization, to control the morphing airfoil. Two neural controllers were trained in a simulation developed through time series modeling on long short-term memory recurrent neural networks. The learned controllers were then tested on the composite wing using two state inference methods in still air and in a wind tunnel at various flow speeds. We compared the performance of our neural controllers to one using traditional position-derivative feedback control methods. Our experimental results validate that the autonomous neural controllers were faster and more accurate than traditional methods. This research shows that deep learning methods can overcome common obstacles for achieving sufficient modeling and control when implementing smart composite actuators in an autonomous aerospace environment.

     
    more » « less