Abstract Background Few studies have systematically investigated robust controllers for lower limb rehabilitation exoskeletons (LLREs) that can safely and effectively assist users with a variety of neuromuscular disorders to walk with full autonomy. One of the key challenges for developing such a robust controller is to handle different degrees of uncertain human-exoskeleton interaction forces from the patients. Consequently, conventional walking controllers either are patient-condition specific or involve tuning of many control parameters, which could behave unreliably and even fail to maintain balance. Methods We present a novel, deep neural network, reinforcement learning-based robust controller for a LLRE based on a decoupled offline human-exoskeleton simulation training with three independent networks, which aims to provide reliable walking assistance against various and uncertain human-exoskeleton interaction forces. The exoskeleton controller is driven by a neural network control policy that acts on a stream of the LLRE’s proprioceptive signals, including joint kinematic states, and subsequently predicts real-time position control targets for the actuated joints. To handle uncertain human interaction forces, the control policy is trained intentionally with an integrated human musculoskeletal model and realistic human-exoskeleton interaction forces. Two other neural networks are connected with the control policy network to predict the interaction forces and muscle coordination. To further increase the robustness of the control policy to different human conditions, we employ domain randomization during training that includes not only randomization of exoskeleton dynamics properties but, more importantly, randomization of human muscle strength to simulate the variability of the patient’s disability. Through this decoupled deep reinforcement learning framework, the trained controller of LLREs is able to provide reliable walking assistance to patients with different degrees of neuromuscular disorders without any control parameter tuning. Results and conclusion A universal, RL-based walking controller is trained and virtually tested on a LLRE system to verify its effectiveness and robustness in assisting users with different disabilities such as passive muscles (quadriplegic), muscle weakness, or hemiplegic conditions without any control parameter tuning. Analysis of the RMSE for joint tracking, CoP-based stability, and gait symmetry shows the effectiveness of the controller. An ablation study also demonstrates the strong robustness of the control policy under large exoskeleton dynamic property ranges and various human-exoskeleton interaction forces. The decoupled network structure allows us to isolate the LLRE control policy network for testing and sim-to-real transfer since it uses only proprioception information of the LLRE (joint sensory state) as the input. Furthermore, the controller is shown to be able to handle different patient conditions without the need for patient-specific control parameter tuning.
more »
« less
Assessment of Task and Joint-Based Exoskeleton Designs for Elbow Joint Rehabilitation
Exoskeletons and robots have been used as a common practice to assist and automate rehabilitation exercises. Exoskeleton fitting and alignments are important factors and challenges that need to be addressed for smooth and safe operations and better outcomes. Such challenges often dictate the exoskeleton design approaches. Some focus on simplifying and mimicking human joints (joint-based) while others have a focus on a specific task (task-based), which does not need to align with the corresponding limb joint/s to generate the desired anatomical motion. In this study, the two design approaches are assessed in an elbow flexion-extension task. The muscle responses have been collected and compared with and without the exoskeletons. Based on 6 with no disability participants, the normalized Electromyography (EMG) RMS values are plotted. The plot profiles and magnitudes are used as a base to assess the exoskeleton alignment. For this specific task, the task-based exoskeleton has shown a profile closer to the one without exoskeleton with a relatively identical support as the joint-based one; the latter is evidenced through most subjects’ muscle response magnitudes. This preliminary data has shown a good methodology and insight towards the assessment of exoskeletons, but more human subject data is needed with different task combinations to further strengthen the findings.
more »
« less
- Award ID(s):
- 1915872
- NSF-PAR ID:
- 10329437
- Date Published:
- Journal Name:
- Frontiers in Biomedical Devices
- Volume:
- 84815
- Page Range / eLocation ID:
- V001T07A002
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Robotic exoskeletons can assist humans with walking by providing supplemental torque in proportion to the user's joint torque. Electromyographic (EMG) control algorithms can estimate a user's joint torque directly using real-time EMG recordings from the muscles that generate the torque. However, EMG signals change as a result of supplemental torque from an exoskeleton, resulting in unreliable estimates of the user's joint torque during active exoskeleton assistance. Here, we present an EMG control framework for robotic exoskeletons that provides consistent joint torque predictions across varying levels of assistance. Experiments with three healthy human participants showed that using diverse training data (from different levels of assistance) enables robust torque predictions, and that a convolutional neural network (CNN), but not a Kalman filter (KF), can capture the non-linear transformations in EMG due to exoskeleton assistance. With diverse training, the CNN could reliably predict joint torque from EMG during zero, low, medium, and high levels of exoskeleton assistance [root mean squared error (RMSE) below 0.096 N-m/kg]. In contrast, without diverse training, RMSE of the CNN ranged from 0.106 to 0.144 N-m/kg. RMSE of the KF ranged from 0.137 to 0.182 N-m/kg without diverse training, and did not improve with diverse training. When participant time is limited, training data should emphasize the highest levels of assistance first and utilize at least 35 full gait cycles for the CNN. The results presented here constitute an important step toward adaptive and robust human augmentation via robotic exoskeletons. This work also highlights the non-linear reorganization of locomotor output when using assistive exoskeletons; significant reductions in EMG activity were observed for the soleus and gastrocnemius, and a significant increase in EMG activity was observed for the erector spinae. Control algorithms that can accommodate spatiotemporal changes in muscle activity have broad implications for exoskeleton-based assistance and rehabilitation following neuromuscular injury.more » « less
-
Task-specific, trajectory-based control methods commonly used in exoskeletons may be appropriate for individuals with paraplegia, but they overly constrain the volitional motion of individuals with remnant voluntary ability (representing a far larger population). Human-exoskeleton systems can be represented in the form of the Euler-Lagrange equations or, equivalently, the port-controlled Hamiltonian equations to design control laws that provide task-invariant assistance across a continuum of activities/environments by altering energetic properties of the human body. We previously introduced a port-controlled Hamiltonian framework that parameterizes the control law through basis functions related to gravitational and gyroscopic terms, which are optimized to fit normalized able-bodied joint torques across multiple walking gaits on different ground inclines. However, this approach did not have the flexibility to reproduce joint torques for a broader set of activities, including stair climbing and stand-to-sit, due to strict assumptions related to input-output passivity, which ensures the human remains in control of energy growth in the closed-loop dynamics. To provide biomimetic assistance across all primary activities of daily life, this paper generalizes this energy shaping framework by incorporating vertical ground reaction forces and global planar orientation into the basis set, while preserving passivity between the human joint torques and human joint velocities. We present an experimental implementation on a powered knee-ankle exoskeleton used by three able-bodied human subjects during walking on various inclines, ramp ascent/descent, and stand-to-sit, demonstrating the versatility of this control approach and its effect on muscular effort.more » « less
-
null (Ed.)Powered ankle exoskeletons that apply assistive torques with optimized timing and magnitude can reduce metabolic cost by ∼10% compared to normal walking. However, finding individualized optimal control parameters is time consuming and must be done independently for different walking modes (e.g., speeds, slopes). Thus, there is a need for exoskeleton controllers that are capable of continuously adapting torque assistance in concert with changing locomotor demands. One option is to use a biologically inspired, model-based control scheme that can capture the adaptive behavior of the human plantarflexors during natural gait. Here, based on previously demonstrated success in a powered ankle-foot prosthesis, we developed an ankle exoskeleton controller that uses a neuromuscular model (NMM) comprised of a Hill type musculotendon driven by a simple positive force feedback reflex loop. To examine the effects of NMM reflex parameter settings on (i) ankle exoskeleton mechanical performance and (ii) users’ physiological response, we recruited nine healthy, young adults to walk on a treadmill at a fixed speed of 1.25 m/s while donning bilateral tethered robotic ankle exoskeletons. To quantify exoskeleton mechanics, we measured exoskeleton torque and power output across a range of NMM controller Gain (0.8–2.0) and Delay (10–40 ms) settings, as well as a High Gain/High Delay (2.0/40 ms) combination. To quantify users’ physiological response, we compared joint kinematics and kinetics, ankle muscle electromyography and metabolic rate between powered and unpowered/zero-torque conditions. Increasing NMM controller reflex Gain caused increases in average ankle exoskeleton torque and net power output, while increasing NMM controller reflex Delay caused a decrease in net ankle exoskeleton power output. Despite systematic reduction in users’ average biological ankle moment with exoskeleton mechanical assistance, we found no NMM controller Gain or Delay settings that yielded changes in metabolic rate. Post hoc analyses revealed weak association at best between exoskeleton and biological mechanics and changes in users’ metabolic rate. Instead, changes in users’ summed ankle joint muscle activity with powered assistance correlated with changes in their metabolic energy use, highlighting the potential to utilize muscle electromyography as a target for on-line optimization in next generation adaptive exoskeleton controllers.more » « less
-
Powered knee exoskeletons have shown potential for mobility restoration and power augmentation. However, the benefits of exoskeletons are partially offset by some design challenges that still limit their positive effects on people. Among them, joint misalignment is a critical aspect mostly because the human knee joint movement is not a fixed-axis rotation. In addition, remarkable mass and stiffness are also limitations. Aiming to minimize joint misalignment, this paper proposes a bio-inspired knee exoskeleton with a joint design that mimics the human knee joint. Moreover, to accomplish a lightweight and high compliance design, a high stiffness cable-tension amplification mechanism is leveraged. Simulation results indicate our design can reduce 49.3 and 71.9% maximum total misalignment for walking and deep squatting activities, respectively. Experiments indicate that the exoskeleton has high compliance (0.4 and 0.1 Nm backdrive torque under unpowered and zero-torque modes, respectively), high control bandwidth (44 Hz), and high control accuracy (1.1 Nm root mean square tracking error, corresponding to 7.3% of the peak torque). This work demonstrates performance improvement compared with state-of-the-art exoskeletons.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1115/DMD2022-1034
