Autonomous lower-limb exoskeletons must modulate assistance based on locomotion mode (e.g., ramp or stair ascent) to adapt to the corresponding changes in human biological joint dynamics. However, current mode classification strategies for exoskeletons often require user-specific tuning, have a slow update rate, and rely on additional sensors outside of the exoskeleton sensor suite. In this study, we introduce a deep convolutional neural network-based locomotion mode classifier for hip exoskeleton applications using an open-source gait biomechanics dataset with various wearable sensors. Our approach removed the limitations of previous systems as it is 1) subject-independent (i.e., no user-specific data), 2) capable of continuously classifying for smooth and seamless mode transitions, and 3) only utilizes minimal wearable sensors native to a conventional hip exoskeleton. We optimized our model, based on several important factors contributing to overall performance, such as transition label timing, model architecture, and sensor placement, which provides a holistic understanding of mode classifier design. Our optimized DL model showed a 3.13% classification error (steady-state: 0.80 ± 0.38% and transitional: 6.49 ± 1.42%), outperforming other machine learning-based benchmarks commonly practiced in the field (p<0.05). Furthermore, our multi-modal analysis indicated that our model can maintain high performance in different settings such as unseen slopes on stairs or ramps. Thus, our study presents a novel locomotion mode framework, capable of advancing robotic exoskeleton applications toward assisting community ambulation.
more »
« less
Anticipation and Delayed Estimation of Sagittal Plane Human Hip Moments using Deep Learning and a Robotic Hip Exoskeleton
Estimating human joint moments using wearable sensors has utility for personalized health monitoring and generalized exoskeleton control. Data-driven models have potential to map wearable sensor data to human joint moments, even with a reduced sensor suite and without subject-specific calibration. In this study, we quantified the RMSE and R 2 of a temporal convolutional network (TCN), trained to estimate human hip moments in the sagittal plane using exoskeleton sensor data (i.e., a hip encoder and thigh- and pelvis-mounted inertial measurement units). We conducted three analyses in which we iteratively retrained the network while: 1) varying the input sequence length of the model, 2) incorporating noncausal data into the input sequence, thus delaying the network estimates, and 3) time shifting the labels to train the model to anticipate (i.e., predict) human hip moments. We found that 930 ms of causal input data maintained model performance while minimizing input sequence length (validation RMSE and R 2 of 0.141±0.014 Nm/kg and 0.883±0.025, respectively). Further, delaying the model estimate by up to 200 ms significantly improved model performance compared to the best causal estimators (p<0.05), improving estimator fidelity in use cases where delayed estimates are acceptable (e.g., in personalized health monitoring or diagnoses). Finally, we found that anticipating hip moments further in time linearly increased model RMSE and decreased R 2 (p<0.05); however, performance remained strong (R 2 >0.85) when predicting up to 200 ms ahead.
more »
« less
- NSF-PAR ID:
- 10470116
- Publisher / Repository:
- IEEE
- Date Published:
- Page Range / eLocation ID:
- 12679 to 12685
- Format(s):
- Medium: X
- Location:
- London, United Kingdom
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Detection of the user’s walking is a critical part of exoskeleton technology for the full automation of smooth and seamless assistance during movement transitions. Researchers have taken several approaches in developing a walk detection system by using different kinds of sensors; however, only a few solutions currently exist which can detect these transitions using only the sensors embedded on a robotic hip exoskeleton (i.e., hip encoders and a trunk IMU), which is a critical consideration for implementing these systems in-the-loop of a hip exoskeleton controller. As a solution, we explored and developed two walk detection models that implemented a finite state machine as the models switched between walking and standing states using two transition conditions: stand-to-walk and walk-to-stand. One of our models dynamically detected the user’s gait cycle using two hip encoders and an IMU; the other model only used the two hip encoders. Our models were developed using a publicly available dataset and were validated online using a wearable sensor suite that contains sensors commonly embedded on robotic hip exoskeletons. The two models were then compared with a foot contact estimation method, which served as a baseline for evaluating our models. The results of our online experiments validated the performance of our models, resulting in 274 ms and 507 ms delay time when using the HIP+IMU and HIP ONLY model, respectively. Therefore, the walk detection models established in our study achieve reliable performance under multiple locomotive contexts without the need for manual tuning or sensors additional to those commonly implemented on robotic hip exoskeletons.more » « less
-
Objective: Semi-active exoskeletons combining lightweight, low powered actuators and passive-elastic elements are a promising approach to portable robotic assistance during locomotion. Here, we introduce a novel semi-active hip exoskeleton concept and evaluate human walking performance across a range of parameters using a tethered robotic testbed. Methods : We emulated semi-active hip exoskeleton (exo) assistance by applying a virtual torsional spring with a fixed rotational stiffness and an equilibrium angle established in terminal swing phase (i.e., via pre-tension into stance). We performed a 2-D sweep of spring stiffness x equilibrium position parameters (30 combinations) across walking speed (1.0, 1.3, and 1.6 m/s) and measured metabolic rate to identify device parameters for optimal metabolic benefit. Results : At each speed, optimal exoskeleton spring settings provided a ∼10% metabolic benefit compared to zero-impedance (ZI). Higher walking speeds required higher exoskeleton stiffness and lower equilibrium angle for maximal metabolic benefit. Optimal parameters tuned to each individual (user-dependent) provided significantly larger metabolic benefit than the average-best settings (user-independent) at all speeds except the fastest (p = 0.021, p = 0.001, and p = 0.098 at 1.0, 1.3, and 1.6 m/s, respectively). We found significant correlation between changes in user's muscle activity and changes in metabolic rate due to exoskeleton assistance, especially for muscles crossing the hip joint. Conclusion : A semi-active hip exoskeleton with spring-parameters personalized to each user could provide metabolic benefit across functional walking speeds. Minimizing muscle activity local to the exoskeleton is a promising approach for tuning assistance on-line on a user-dependent basis.more » « less
-
Step length is a critical gait parameter that allows a quantitative assessment of gait asymmetry. Gait asymmetry can lead to many potential health threats such as joint degeneration, difficult balance control, and gait inefficiency. Therefore, accurate step length estimation is essential to understand gait asymmetry and provide appropriate clinical interventions or gait training programs. The conventional method for step length measurement relies on using foot-mounted inertial measurement units (IMUs). However, this may not be suitable for real-world applications due to sensor signal drift and the potential obtrusiveness of using distal sensors. To overcome this challenge, we propose a deep convolutional neural network-based step length estimation using only proximal wearable sensors (hip goniometer, trunk IMU, and thigh IMU) capable of generalizing to various walking speeds. To evaluate this approach, we utilized treadmill data collected from sixteen able-bodied subjects at different walking speeds. We tested our optimized model on the overground walking data. Our CNN model estimated the step length with an average mean absolute error of 2.89 ± 0.89 cm across all subjects and walking speeds. Since wearable sensors and CNN models are easily deployable in real-time, our study findings can provide personalized real-time step length monitoring in wearable assistive devices and gait training programs.more » « less
-
High-performance actuators are crucial to enable mechanical versatility of wearable robots, which are required to be lightweight, highly backdrivable, and with high bandwidth. State-of-the-art actuators, e.g., series elastic actuators (SEAs), have to compromise bandwidth to improve compliance (i.e., backdrivability). We describe the design and human-robot interaction modeling of a portable hip exoskeleton based on our custom quasi-direct drive (QDD) actuation (i.e., a high torque density motor with low ratio gear). We also present a model-based performance benchmark comparison of representative actuators in terms of torque capability, control bandwidth, backdrivability, and force tracking accuracy. This paper aims to corroborate the underlying philosophy of “design for control“, namely meticulous robot design can simplify control algorithms while ensuring high performance. Following this idea, we create a lightweight bilateral hip exoskeleton to reduce joint loadings during normal activities, including walking and squatting. Experiments indicate that the exoskeleton is able to produce high nominal torque (17.5 Nm), high backdrivability (0.4 Nm backdrive torque), high bandwidth (62.4 Hz), and high control accuracy (1.09 Nm root mean square tracking error, 5.4% of the desired peak torque). Its controller is versatile to assist walking at different speeds and squatting. This work demonstrates performance improvement compared with state-of-the-art exoskeletons.more » « less
