A novel wearable solution using soft robotic sensors (SRS) has been investigated to model foot-ankle kinematics during gait cycles. The capacitance of SRS related to foot-ankle basic movements was quantified during the gait movements of 20 participants on a flat surface as well as a cross-sloped surface. In order to evaluate the power of SRS in modeling foot-ankle kinematics, three-dimensional (3D) motion capture data was also collected for analyzing gait movement. Three different approaches were employed to quantify the relationship between the SRS and the 3D motion capture system, including multivariable linear regression, an artificial neural network (ANN), and a time-series long short-term memory (LSTM) network. Models were compared based on the root mean squared error (RMSE) of the prediction of the joint angle of the foot in the sagittal and frontal plane, collected from the motion capture system. There was not a significant difference between the error rates of the three different models. The ANN resulted in an average RMSE of 3.63, being slightly more successful in comparison to the average RMSE values of 3.94 and 3.98 resulting from multivariable linear regression and LSTM, respectively. The low error rate of the models revealed the high performance of SRS in capturing foot-ankle kinematics during the human gait cycle.
more »
« less
Closing the Wearable Gap: Foot–ankle kinematic modeling via deep learning models based on a smart sock wearable
Abstract The development of wearable technology, which enables motion tracking analysis for human movement outside the laboratory, can improve awareness of personal health and performance. This study used a wearable smart sock prototype to track foot–ankle kinematics during gait movement. Multivariable linear regression and two deep learning models, including long short-term memory (LSTM) and convolutional neural networks, were trained to estimate the joint angles in sagittal and frontal planes measured by an optical motion capture system. Participant-specific models were established for ten healthy subjects walking on a treadmill. The prototype was tested at various walking speeds to assess its ability to track movements for multiple speeds and generalize models for estimating joint angles in sagittal and frontal planes. LSTM outperformed other models with lower mean absolute error (MAE), lower root mean squared error, and higher R -squared values. The average MAE score was less than 1.138° and 0.939° in sagittal and frontal planes, respectively, when training models for each speed and 2.15° and 1.14° when trained and evaluated for all speeds. These results indicate wearable smart socks to generalize foot–ankle kinematics over various walking speeds with relatively low error and could consequently be used to measure gait parameters without the need for a lab-constricted motion capture system.
more »
« less
- Award ID(s):
- 1827652
- PAR ID:
- 10437667
- Date Published:
- Journal Name:
- Wearable Technologies
- Volume:
- 4
- ISSN:
- 2631-7176
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The purpose of this study was to use 3D motion capture and stretchable soft robotic sensors (SRS) to collect foot-ankle movement on participants performing walking gait cycles on flat and sloped surfaces. The primary aim was to assess differences between 3D motion capture and a new SRS-based wearable solution. Given the complex nature of using a linear solution to accurately quantify the movement of triaxial joints during a dynamic gait movement, 20 participants performing multiple walking trials were measured. The participant gait data was then upscaled (for the SRS), time-aligned (based on right heel strikes), and smoothed using filtering methods. A multivariate linear model was developed to assess goodness-of-fit based on mean absolute error (MAE; 1.54), root mean square error (RMSE; 1.96), and absolute R2 (R2; 0.854). Two and three SRS combinations were evaluated to determine if similar fit scores could be achieved using fewer sensors. Inversion (based on MAE and RMSE) and plantar flexion (based on R2) sensor removal provided second-best fit scores. Given that the scores indicate a high level of fit, with further development, an SRS-based wearable solution has the potential to measure motion during gait- based tasks with the accuracy of a 3D motion capture system.more » « less
-
Marker-based motion capture is a fundamental tool in biomechanical analysis, yet comes with major constraints such as time, cost and accessibility. This study aimed to validate the use of OpenCap, a free, markerless motion capture system compared to a marker-based motion capture system to measure lower extremity kinematics during functional tasks. 20 individuals from an athletic population (18 females, 2 males) performed two gait trials (walking, running) and three functional tasks (double leg squat, countermovement jump, jump-landing). Lower extremity peak joint kinematics were collected simultaneously using Vicon and OpenCap to assess the validity of markerless motion capture. Strong agreements were observed in the frontal hip plane joint kinematics across all tasks with root mean squared errors below 6◦. Moderate agreements were observed in the sagittal knee plane joint kinematics (4–10◦) and there was a weak agreement in the gait trials of the sagittal hip measures (>10◦). The results from the study indicate the need for further research on the use of OpenCap in clinical settings. The findings align with previous studies with similar agreements observed in the frontal hip and sagittal knee measures. Validating the use of an open-source motion capture software could provide clinicians and researchers an accessible tool for in depth biomechanical assessments.more » « less
-
null (Ed.)Background: Wearable technology is used by clinicians and researchers and play a critical role in biomechanical assessments and rehabilitation. Objective: The purpose of this research is to validate a soft robotic stretch (SRS) sensor embedded in a compression knee brace (smart knee brace) against a motion capture system focusing on knee joint kinematics. Methods: Sixteen participants donned the smart knee brace and completed three separate tasks: non-weight bearing knee flexion/extension, bodyweight air squats, and gait trials. Adjusted R2 for goodness of fit (R2), root mean square error (RMSE), and mean absolute error (MAE) between the SRS sensor and motion capture kinematic data for all three tasks were assessed. Results: For knee flexion/extension: R2 = 0.799, RMSE = 5.470, MAE = 4.560; for bodyweight air squats: R2 = 0.957, RMSE = 8.127, MAE = 6.870; and for gait trials: R2 = 0.565, RMSE = 9.190, MAE = 7.530 were observed. Conclusions: The smart knee brace demonstrated a higher goodness of fit and accuracy during weight-bearing air squats followed by non-weight bearing knee flexion/extension and a lower goodness of fit and accuracy during gait, which can be attributed to the SRS sensor position and orientation, rather than range of motion achieved in each task.more » « less
-
Step length is a critical gait parameter that allows a quantitative assessment of gait asymmetry. Gait asymmetry can lead to many potential health threats such as joint degeneration, difficult balance control, and gait inefficiency. Therefore, accurate step length estimation is essential to understand gait asymmetry and provide appropriate clinical interventions or gait training programs. The conventional method for step length measurement relies on using foot-mounted inertial measurement units (IMUs). However, this may not be suitable for real-world applications due to sensor signal drift and the potential obtrusiveness of using distal sensors. To overcome this challenge, we propose a deep convolutional neural network-based step length estimation using only proximal wearable sensors (hip goniometer, trunk IMU, and thigh IMU) capable of generalizing to various walking speeds. To evaluate this approach, we utilized treadmill data collected from sixteen able-bodied subjects at different walking speeds. We tested our optimized model on the overground walking data. Our CNN model estimated the step length with an average mean absolute error of 2.89 ± 0.89 cm across all subjects and walking speeds. Since wearable sensors and CNN models are easily deployable in real-time, our study findings can provide personalized real-time step length monitoring in wearable assistive devices and gait training programs.more » « less
An official website of the United States government

