skip to main content


Title: Neuromechanics and Energetics of Walking With an Ankle Exoskeleton Using Neuromuscular-Model Based Control: A Parameter Study
Powered ankle exoskeletons that apply assistive torques with optimized timing and magnitude can reduce metabolic cost by ∼10% compared to normal walking. However, finding individualized optimal control parameters is time consuming and must be done independently for different walking modes (e.g., speeds, slopes). Thus, there is a need for exoskeleton controllers that are capable of continuously adapting torque assistance in concert with changing locomotor demands. One option is to use a biologically inspired, model-based control scheme that can capture the adaptive behavior of the human plantarflexors during natural gait. Here, based on previously demonstrated success in a powered ankle-foot prosthesis, we developed an ankle exoskeleton controller that uses a neuromuscular model (NMM) comprised of a Hill type musculotendon driven by a simple positive force feedback reflex loop. To examine the effects of NMM reflex parameter settings on (i) ankle exoskeleton mechanical performance and (ii) users’ physiological response, we recruited nine healthy, young adults to walk on a treadmill at a fixed speed of 1.25 m/s while donning bilateral tethered robotic ankle exoskeletons. To quantify exoskeleton mechanics, we measured exoskeleton torque and power output across a range of NMM controller Gain (0.8–2.0) and Delay (10–40 ms) settings, as well as a High Gain/High Delay (2.0/40 ms) combination. To quantify users’ physiological response, we compared joint kinematics and kinetics, ankle muscle electromyography and metabolic rate between powered and unpowered/zero-torque conditions. Increasing NMM controller reflex Gain caused increases in average ankle exoskeleton torque and net power output, while increasing NMM controller reflex Delay caused a decrease in net ankle exoskeleton power output. Despite systematic reduction in users’ average biological ankle moment with exoskeleton mechanical assistance, we found no NMM controller Gain or Delay settings that yielded changes in metabolic rate. Post hoc analyses revealed weak association at best between exoskeleton and biological mechanics and changes in users’ metabolic rate. Instead, changes in users’ summed ankle joint muscle activity with powered assistance correlated with changes in their metabolic energy use, highlighting the potential to utilize muscle electromyography as a target for on-line optimization in next generation adaptive exoskeleton controllers.  more » « less
Award ID(s):
1830215
NSF-PAR ID:
10231184
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Frontiers in Bioengineering and Biotechnology
Volume:
9
ISSN:
2296-4185
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Proportional myoelectric controller (PMC) has been one of the most common assistance strategies for robotic exoskeletons due to its ability to modulate assistance level directly based on the user's muscle activation. However, existing PMC strategies (static or user-adaptive) scale torque linearly with muscle activation level and fail to address complex and non-linear mapping between muscle activation and joint torque. Furthermore, previously presented adaptive PMC strategies do not allow for environmental changes (such as changes in ground slopes) and modulate the system's assistance level over many steps. In this work, we designed a novel user- and environment-adaptive PMC for a knee exoskeleton that modulates the peak assistance level based on the slope level during locomotion. We recruited nine able-bodied adults to test and compare the effects of three different PMC strategies (static, user-adaptive, and user- and environment-adaptive) on the user's metabolic cost and the knee extensor muscle activation level during load-carriage walking (6.8 kg) in three inclination settings (0°, 4.5°, and 8.5°). The results showed that only the user- and environment-adaptive PMC was effective in significantly reducing user's metabolic cost (5.8% reduction) and the knee extensor muscle activation (19% reduction) during 8.5° incline walking compared to the unpowered condition while other PMCs did not have as large of an effect. This control framework highlights the viability of implementing an assistance paradigm that can dynamically adjust to the user's biological demand, allowing for a more personalized assistance paradigm. 
    more » « less
  2. Objective: Semi-active exoskeletons combining lightweight, low powered actuators and passive-elastic elements are a promising approach to portable robotic assistance during locomotion. Here, we introduce a novel semi-active hip exoskeleton concept and evaluate human walking performance across a range of parameters using a tethered robotic testbed. Methods : We emulated semi-active hip exoskeleton (exo) assistance by applying a virtual torsional spring with a fixed rotational stiffness and an equilibrium angle established in terminal swing phase (i.e., via pre-tension into stance). We performed a 2-D sweep of spring stiffness x equilibrium position parameters (30 combinations) across walking speed (1.0, 1.3, and 1.6 m/s) and measured metabolic rate to identify device parameters for optimal metabolic benefit. Results : At each speed, optimal exoskeleton spring settings provided a ∼10% metabolic benefit compared to zero-impedance (ZI). Higher walking speeds required higher exoskeleton stiffness and lower equilibrium angle for maximal metabolic benefit. Optimal parameters tuned to each individual (user-dependent) provided significantly larger metabolic benefit than the average-best settings (user-independent) at all speeds except the fastest (p = 0.021, p = 0.001, and p = 0.098 at 1.0, 1.3, and 1.6 m/s, respectively). We found significant correlation between changes in user's muscle activity and changes in metabolic rate due to exoskeleton assistance, especially for muscles crossing the hip joint. Conclusion : A semi-active hip exoskeleton with spring-parameters personalized to each user could provide metabolic benefit across functional walking speeds. Minimizing muscle activity local to the exoskeleton is a promising approach for tuning assistance on-line on a user-dependent basis. 
    more » « less
  3. Robotic exoskeletons have the capability to improve community ambulation in aging individuals. These exoskeleton controllers utilize different environmental information such as walking speeds and slope inclines to provide corresponding assistance. Several numerical approaches for estimating this environmental information have been implemented; however, they tend to be limited during dynamic changes. A possible solution is a machine learning model utilizing the user's electromyography (EMG) signals along with mechanical sensor data. We developed a neural network-based walking speed and slope estimator for a powered hip exoskeleton and explored the EMG signal contributions in both static and dynamic settings while wearing the device. We also analyzed the performance of different EMG electrode placements. The resulting machine learning model achieved error rates below 0.08 m/s RMSE and 1.3 RMSE. Our study findings from four able-bodied and two elderly subjects indicate that EMG can improve the performance by reducing the error rate by 14.8% compared to the model using only mechanical sensors. Additionally, results show that using EMG electrode configuration within the exoskeleton interface region is sufficient for the EMG model performance. 
    more » « less
  4. Abstract Background

    Walking speed and energy economy tend to decline with age. Lower-limb exoskeletons have demonstrated potential to improve either measure, but primarily in studies conducted on healthy younger adults. Promising techniques like optimization of exoskeleton assistance have yet to be tested with older populations, while speed and energy consumption have yet to be simultaneously optimized for any population.

    Methods

    We investigated the effectiveness of human-in-the-loop optimization of ankle exoskeletons with older adults. Ten healthy adults > 65 years of age (5 females; mean age: 72 ± 3 yrs) participated in approximately 240 min of training and optimization with tethered ankle exoskeletons on a self-paced treadmill. Multi-objective human-in-the-loop optimization was used to identify assistive ankle plantarflexion torque patterns that simultaneously improved self-selected walking speed and metabolic rate. The effects of optimized exoskeleton assistance were evaluated in separate trials.

    Results

    Optimized exoskeleton assistance improved walking performance for older adults. Both objectives were simultaneously improved; self-selected walking speed increased by 8% (0.10 m/s;p = 0.001) and metabolic rate decreased by 19% (p = 0.007), resulting in a 25% decrease in energetic cost of transport (p = 8e-4) compared to walking with exoskeletons applying zero torque. Compared to younger participants in studies optimizing a single objective, our participants required lower exoskeleton torques, experienced smaller improvements in energy use, and required more time for motor adaptation.

    Conclusions

    Our results confirm that exoskeleton assistance can improve walking performance for older adults and show that multiple objectives can be simultaneously addressed through human-in-the-loop optimization.

     
    more » « less
  5. Abstract Background Few studies have systematically investigated robust controllers for lower limb rehabilitation exoskeletons (LLREs) that can safely and effectively assist users with a variety of neuromuscular disorders to walk with full autonomy. One of the key challenges for developing such a robust controller is to handle different degrees of uncertain human-exoskeleton interaction forces from the patients. Consequently, conventional walking controllers either are patient-condition specific or involve tuning of many control parameters, which could behave unreliably and even fail to maintain balance. Methods We present a novel, deep neural network, reinforcement learning-based robust controller for a LLRE based on a decoupled offline human-exoskeleton simulation training with three independent networks, which aims to provide reliable walking assistance against various and uncertain human-exoskeleton interaction forces. The exoskeleton controller is driven by a neural network control policy that acts on a stream of the LLRE’s proprioceptive signals, including joint kinematic states, and subsequently predicts real-time position control targets for the actuated joints. To handle uncertain human interaction forces, the control policy is trained intentionally with an integrated human musculoskeletal model and realistic human-exoskeleton interaction forces. Two other neural networks are connected with the control policy network to predict the interaction forces and muscle coordination. To further increase the robustness of the control policy to different human conditions, we employ domain randomization during training that includes not only randomization of exoskeleton dynamics properties but, more importantly, randomization of human muscle strength to simulate the variability of the patient’s disability. Through this decoupled deep reinforcement learning framework, the trained controller of LLREs is able to provide reliable walking assistance to patients with different degrees of neuromuscular disorders without any control parameter tuning. Results and conclusion A universal, RL-based walking controller is trained and virtually tested on a LLRE system to verify its effectiveness and robustness in assisting users with different disabilities such as passive muscles (quadriplegic), muscle weakness, or hemiplegic conditions without any control parameter tuning. Analysis of the RMSE for joint tracking, CoP-based stability, and gait symmetry shows the effectiveness of the controller. An ablation study also demonstrates the strong robustness of the control policy under large exoskeleton dynamic property ranges and various human-exoskeleton interaction forces. The decoupled network structure allows us to isolate the LLRE control policy network for testing and sim-to-real transfer since it uses only proprioception information of the LLRE (joint sensory state) as the input. Furthermore, the controller is shown to be able to handle different patient conditions without the need for patient-specific control parameter tuning. 
    more » « less