More Like this

1. Robust walking control of a lower limb rehabilitation exoskeleton coupled with a musculoskeletal model via deep reinforcement learning

   https://doi.org/10.1186/s12984-023-01147-2  

   Luo, Shuzhen; Androwis, Ghaith; Adamovich, Sergei; Nunez, Erick; Su, Hao; Zhou, Xianlian (December 2023, Journal of NeuroEngineering and Rehabilitation)

   Abstract Background Few studies have systematically investigated robust controllers for lower limb rehabilitation exoskeletons (LLREs) that can safely and effectively assist users with a variety of neuromuscular disorders to walk with full autonomy. One of the key challenges for developing such a robust controller is to handle different degrees of uncertain human-exoskeleton interaction forces from the patients. Consequently, conventional walking controllers either are patient-condition specific or involve tuning of many control parameters, which could behave unreliably and even fail to maintain balance. Methods We present a novel, deep neural network, reinforcement learning-based robust controller for a LLRE based on a decoupled offline human-exoskeleton simulation training with three independent networks, which aims to provide reliable walking assistance against various and uncertain human-exoskeleton interaction forces. The exoskeleton controller is driven by a neural network control policy that acts on a stream of the LLRE’s proprioceptive signals, including joint kinematic states, and subsequently predicts real-time position control targets for the actuated joints. To handle uncertain human interaction forces, the control policy is trained intentionally with an integrated human musculoskeletal model and realistic human-exoskeleton interaction forces. Two other neural networks are connected with the control policy network to predict the interaction forces and muscle coordination. To further increase the robustness of the control policy to different human conditions, we employ domain randomization during training that includes not only randomization of exoskeleton dynamics properties but, more importantly, randomization of human muscle strength to simulate the variability of the patient’s disability. Through this decoupled deep reinforcement learning framework, the trained controller of LLREs is able to provide reliable walking assistance to patients with different degrees of neuromuscular disorders without any control parameter tuning. Results and conclusion A universal, RL-based walking controller is trained and virtually tested on a LLRE system to verify its effectiveness and robustness in assisting users with different disabilities such as passive muscles (quadriplegic), muscle weakness, or hemiplegic conditions without any control parameter tuning. Analysis of the RMSE for joint tracking, CoP-based stability, and gait symmetry shows the effectiveness of the controller. An ablation study also demonstrates the strong robustness of the control policy under large exoskeleton dynamic property ranges and various human-exoskeleton interaction forces. The decoupled network structure allows us to isolate the LLRE control policy network for testing and sim-to-real transfer since it uses only proprioception information of the LLRE (joint sensory state) as the input. Furthermore, the controller is shown to be able to handle different patient conditions without the need for patient-specific control parameter tuning. 

   more » « less
2. Neural Networks Trained via Reinforcement Learning Stabilize Walking of a Three-Dimensional Biped Model With Exoskeleton Applications

   https://doi.org/10.3389/frobt.2021.710999  

   Liu, Chujun; Audu, Musa L.; Triolo, Ronald J.; Quinn, Roger D. (August 2021, Frontiers in Robotics and AI)

   null (Ed.)

   Our group is developing a cyber-physical walking system (CPWS) for people paralyzed by spinal cord injuries (SCI). The current CPWS consists of a functional neuromuscular stimulation (FNS) system and a powered lower-limb exoskeleton for walking with leg movements in the sagittal plane. We are developing neural control systems that learn to assist the user of this CPWS to walk with stability. In a previous publication (Liu et al., Biomimetics, 2019, 4, 28), we showed a neural controller that stabilized a simulated biped in the sagittal plane. We are considering adding degrees of freedom to the CPWS to allow more natural walking movements and improved stability. Thus, in this paper, we present a new neural network enhanced control system that stabilizes a three-dimensional simulated biped model of a human wearing an exoskeleton. Results show that it stabilizes human/exoskeleton models and is robust to impact disturbances. The simulated biped walks at a steady pace in a range of typical human ambulatory speeds from 0.7 to 1.3 m/s, follows waypoints at a precision of 0.3 m, remains stable, and continues walking forward despite impact disturbances and adapts its speed to compensate for persistent external disturbances. Furthermore, the neural network controller stabilizes human models of different statures from 1.4 to 2.2 m tall without any changes to the control parameters. Please see videos at the following link: 3D biped walking control . 

   more » « less
3. Task-agnostic exoskeleton control via biological joint moment estimation

   https://doi.org/10.1038/s41586-024-08157-7  

   Molinaro, Dean D; Scherpereel, Keaton L; Schonhaut, Ethan B; Evangelopoulos, Georgios; Shepherd, Max K; Young, Aaron J (November 2024, Nature)

   Lower-limb exoskeletons have the potential to transform the way we move1,2,3,4,5,6,7,8,9,10,11,12,13,14, but current state-of-the-art controllers cannot accommodate the rich set of possible human behaviours that range from cyclic and predictable to transitory and unstructured. We introduce a task-agnostic controller that assists the user on the basis of instantaneous estimates of lower-limb biological joint moments from a deep neural network. By estimating both hip and knee moments in-the-loop, our approach provided multi-joint, coordinated assistance through our autonomous, clothing-integrated exoskeleton. When deployed during 28 activities, spanning cyclic locomotion to unstructured tasks (for example, passive meandering and high-speed lateral cutting), the network accurately estimated hip and knee moments with an average R2 of 0.83 relative to ground truth. Further, our approach significantly outperformed a best-case task classifier-based method constructed from splines and impedance parameters. When tested on ten activities (including level walking, running, lifting a 25 lb (roughly 11 kg) weight and lunging), our controller significantly reduced user energetics (metabolic cost or lower-limb biological joint work depending on the task) relative to the zero torque condition, ranging from 5.3 to 19.7%, without any manual controller modifications among activities. Thus, this task-agnostic controller can enable exoskeletons to aid users across a broad spectrum of human activities, a necessity for real-world viability. 

   more » « less
4. A Lightweight Exoskeleton-Based Portable Gait Data Collection System

   https://doi.org/10.3390/s21030781  

   Haque, Md Rejwanul; Imtiaz, Masudul H.; Kwak, Samuel T.; Sazonov, Edward; Chang, Young-Hui; Shen, Xiangrong (February 2021, Sensors)

   null (Ed.)

   For the controller of wearable lower-limb assistive devices, quantitative understanding of human locomotion serves as the basis for human motion intent recognition and joint-level motion control. Traditionally, the required gait data are obtained in gait research laboratories, utilizing marker-based optical motion capture systems. Despite the high accuracy of measurement, marker-based systems are largely limited to laboratory environments, making it nearly impossible to collect the desired gait data in real-world daily-living scenarios. To address this problem, the authors propose a novel exoskeleton-based gait data collection system, which provides the capability of conducting independent measurement of lower limb movement without the need for stationary instrumentation. The basis of the system is a lightweight exoskeleton with articulated knee and ankle joints. To minimize the interference to a wearer’s natural lower-limb movement, a unique two-degrees-of-freedom joint design is incorporated, integrating a primary degree of freedom for joint motion measurement with a passive degree of freedom to allow natural joint movement and improve the comfort of use. In addition to the joint-embedded goniometers, the exoskeleton also features multiple positions for the mounting of inertia measurement units (IMUs) as well as foot-plate-embedded force sensing resistors to measure the foot plantar pressure. All sensor signals are routed to a microcontroller for data logging and storage. To validate the exoskeleton-provided joint angle measurement, a comparison study on three healthy participants was conducted, which involves locomotion experiments in various modes, including overground walking, treadmill walking, and sit-to-stand and stand-to-sit transitions. Joint angle trajectories measured with an eight-camera motion capture system served as the benchmark for comparison. Experimental results indicate that the exoskeleton-measured joint angle trajectories closely match those obtained through the optical motion capture system in all modes of locomotion (correlation coefficients of 0.97 and 0.96 for knee and ankle measurements, respectively), clearly demonstrating the accuracy and reliability of the proposed gait measurement system. 

   more » « less
5. Exoskeleton gait training on real-world terrain improves spatiotemporal performance in cerebral palsy

   https://doi.org/10.3389/fbioe.2024.1503050  

   Tagoe, Emmanuella A; Fang, Ying; Williams, Jack R; Stone, Julie L; Lerner, Zachary F (December 2024, Frontiers in Bioengineering and Biotechnology)

   IntroductionWalking is essential for daily life but poses a significant challenge for many individuals with neurological conditions like cerebral palsy (CP), which is the leading cause of childhood walking disability. Although lower-limb exoskeletons show promise in improving walking ability in laboratory and controlled overground settings, it remains unknown whether these benefits translate to real-world environments, where they could have the greatest impact. MethodsThis feasibility study evaluated whether an untethered ankle exoskeleton with an adaptable controller can improve spatiotemporal outcomes in eight individuals with CP after low-frequency exoskeleton-assisted gait training on real-world terrain. ResultsComparing post- and pre-assessment, assisted walking speed increased by 11% and cadence by 7% (p= 0.003;p= 0.006), while unassisted walking speed increased by 8% and cadence by 5% (p= 0.009;p= 0.012). In the post-assessment, assisted walking speed increased by 9% and stride length by 8% relative to unassisted walking (p< 0.001;p< 0.001). Improvements in walking speed were more strongly associated with longer strides than higher cadence (R²= 0.92;R²= 0.68). Muscle activity outcomes, including co-contraction of the soleus and tibialis anterior, did not significantly change after training. DiscussionThese findings highlight the spatiotemporal benefits of an adaptive ankle exoskeleton for individuals with CP in real-world settings after short-term training. This work paves the way for future randomized controlled trials (RCTs) to evaluate the isolated effects of adaptive ankle exoskeletons on gait performance and neuromuscular outcomes in individuals with CP in real-world environments 

   more » « less