skip to main content


Title: Closing the Wearable Gap—Part IV: 3D Motion Capture Cameras Versus Soft Robotic Sensors Comparison of Gait Movement Assessment
The purpose of this study was to use 3D motion capture and stretchable soft robotic sensors (SRS) to collect foot-ankle movement on participants performing walking gait cycles on flat and sloped surfaces. The primary aim was to assess differences between 3D motion capture and a new SRS-based wearable solution. Given the complex nature of using a linear solution to accurately quantify the movement of triaxial joints during a dynamic gait movement, 20 participants performing multiple walking trials were measured. The participant gait data was then upscaled (for the SRS), time-aligned (based on right heel strikes), and smoothed using filtering methods. A multivariate linear model was developed to assess goodness-of-fit based on mean absolute error (MAE; 1.54), root mean square error (RMSE; 1.96), and absolute R2 (R2; 0.854). Two and three SRS combinations were evaluated to determine if similar fit scores could be achieved using fewer sensors. Inversion (based on MAE and RMSE) and plantar flexion (based on R2) sensor removal provided second-best fit scores. Given that the scores indicate a high level of fit, with further development, an SRS-based wearable solution has the potential to measure motion during gait- based tasks with the accuracy of a 3D motion capture system.  more » « less
Award ID(s):
1827652
NSF-PAR ID:
10181319
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Electronics
Volume:
8
Issue:
12
ISSN:
2079-9292
Page Range / eLocation ID:
1382
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Background: Wearable technology is used by clinicians and researchers and play a critical role in biomechanical assessments and rehabilitation. Objective: The purpose of this research is to validate a soft robotic stretch (SRS) sensor embedded in a compression knee brace (smart knee brace) against a motion capture system focusing on knee joint kinematics. Methods: Sixteen participants donned the smart knee brace and completed three separate tasks: non-weight bearing knee flexion/extension, bodyweight air squats, and gait trials. Adjusted R2 for goodness of fit (R2), root mean square error (RMSE), and mean absolute error (MAE) between the SRS sensor and motion capture kinematic data for all three tasks were assessed. Results: For knee flexion/extension: R2 = 0.799, RMSE = 5.470, MAE = 4.560; for bodyweight air squats: R2 = 0.957, RMSE = 8.127, MAE = 6.870; and for gait trials: R2 = 0.565, RMSE = 9.190, MAE = 7.530 were observed. Conclusions: The smart knee brace demonstrated a higher goodness of fit and accuracy during weight-bearing air squats followed by non-weight bearing knee flexion/extension and a lower goodness of fit and accuracy during gait, which can be attributed to the SRS sensor position and orientation, rather than range of motion achieved in each task. 
    more » « less
  2. A novel wearable solution using soft robotic sensors (SRS) has been investigated to model foot-ankle kinematics during gait cycles. The capacitance of SRS related to foot-ankle basic movements was quantified during the gait movements of 20 participants on a flat surface as well as a cross-sloped surface. In order to evaluate the power of SRS in modeling foot-ankle kinematics, three-dimensional (3D) motion capture data was also collected for analyzing gait movement. Three different approaches were employed to quantify the relationship between the SRS and the 3D motion capture system, including multivariable linear regression, an artificial neural network (ANN), and a time-series long short-term memory (LSTM) network. Models were compared based on the root mean squared error (RMSE) of the prediction of the joint angle of the foot in the sagittal and frontal plane, collected from the motion capture system. There was not a significant difference between the error rates of the three different models. The ANN resulted in an average RMSE of 3.63, being slightly more successful in comparison to the average RMSE values of 3.94 and 3.98 resulting from multivariable linear regression and LSTM, respectively. The low error rate of the models revealed the high performance of SRS in capturing foot-ankle kinematics during the human gait cycle. 
    more » « less
  3. The linearity of soft robotic sensors (SRS) was recently validated for movement angle assessment using a rigid body structure that accurately depicted critical movements of the foot–ankle complex. The purpose of this study was to continue the validation of SRS for joint angle movement capture on 10 participants (five male and five female) performing ankle movements in a non-weight bearing, high-seated, sitting position. The four basic ankle movements—plantar flexion (PF), dorsiflexion (DF), inversion (INV), and eversion (EVR)—were assessed individually in order to select good placement and orientation configurations (POCs) for four SRS positioned to capture each movement type. PF, INV, and EVR each had three POCs identified based on bony landmarks of the foot and ankle while the DF location was only tested for one POC. Each participant wore a specialized compression sock where the SRS could be consistently tested from all POCs for each participant. The movement data collected from each sensor was then compared against 3D motion capture data. R-squared and root-mean-squared error averages were used to assess relative and absolute measures of fit to motion capture output. Participant robustness, opposing movements, and gender were also used to identify good SRS POC placement for foot–ankle movement capture. 
    more » « less
  4. Abstract The development of wearable technology, which enables motion tracking analysis for human movement outside the laboratory, can improve awareness of personal health and performance. This study used a wearable smart sock prototype to track foot–ankle kinematics during gait movement. Multivariable linear regression and two deep learning models, including long short-term memory (LSTM) and convolutional neural networks, were trained to estimate the joint angles in sagittal and frontal planes measured by an optical motion capture system. Participant-specific models were established for ten healthy subjects walking on a treadmill. The prototype was tested at various walking speeds to assess its ability to track movements for multiple speeds and generalize models for estimating joint angles in sagittal and frontal planes. LSTM outperformed other models with lower mean absolute error (MAE), lower root mean squared error, and higher R -squared values. The average MAE score was less than 1.138° and 0.939° in sagittal and frontal planes, respectively, when training models for each speed and 2.15° and 1.14° when trained and evaluated for all speeds. These results indicate wearable smart socks to generalize foot–ankle kinematics over various walking speeds with relatively low error and could consequently be used to measure gait parameters without the need for a lab-constricted motion capture system. 
    more » « less
  5. Background: An induced loss of balance resulting from a postural perturbation has been reported as the primary source for postural instability leading to falls. Hence; early detection of postural instability with novel wearable sensor-based measures may aid in reducing falls and fall-related injuries. The purpose of the study was to validate the use of a stretchable soft robotic sensor (SRS) to detect ankle joint kinematics during both unexpected and expected slip and trip perturbations. Methods: Ten participants (age: 23.7 ± 3.13 years; height: 170.47 ± 8.21 cm; mass: 82.86 ± 23.4 kg) experienced a counterbalanced exposure of an unexpected slip, an unexpected trip, an expected slip, and an expected trip using treadmill perturbations. Ankle joint kinematics for dorsiflexion and plantarflexion were quantified using three-dimensional (3D) motion capture through changes in ankle joint range of motion and using the SRS through changes in capacitance when stretched due to ankle movements during the perturbations. Results: A greater R-squared and lower root mean square error in the linear regression model was observed in comparing ankle joint kinematics data from motion capture with stretch sensors. Conclusions: Results from the study demonstrated that 71.25% of the trials exhibited a minimal error of less than 4.0 degrees difference from the motion capture system and a greater than 0.60 R-squared value in the linear model; suggesting a moderate to high accuracy and minimal errors in comparing SRS to a motion capture system. Findings indicate that the stretch sensors could be a feasible option in detecting ankle joint kinematics during slips and trips. 
    more » « less