skip to main content


Title: Wearable Sensor-Based Step Length Estimation During Overground Locomotion Using a Deep Convolutional Neural Network
Step length is a critical gait parameter that allows a quantitative assessment of gait asymmetry. Gait asymmetry can lead to many potential health threats such as joint degeneration, difficult balance control, and gait inefficiency. Therefore, accurate step length estimation is essential to understand gait asymmetry and provide appropriate clinical interventions or gait training programs. The conventional method for step length measurement relies on using foot-mounted inertial measurement units (IMUs). However, this may not be suitable for real-world applications due to sensor signal drift and the potential obtrusiveness of using distal sensors. To overcome this challenge, we propose a deep convolutional neural network-based step length estimation using only proximal wearable sensors (hip goniometer, trunk IMU, and thigh IMU) capable of generalizing to various walking speeds. To evaluate this approach, we utilized treadmill data collected from sixteen able-bodied subjects at different walking speeds. We tested our optimized model on the overground walking data. Our CNN model estimated the step length with an average mean absolute error of 2.89 ± 0.89 cm across all subjects and walking speeds. Since wearable sensors and CNN models are easily deployable in real-time, our study findings can provide personalized real-time step length monitoring in wearable assistive devices and gait training programs.  more » « less
Award ID(s):
1830215
NSF-PAR ID:
10339074
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)
Page Range / eLocation ID:
4897 to 4900
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper presents a portable inertial measurement unit (IMU)-based motion sensing system and proposed an adaptive gait phase detection approach for non-steady state walking and multiple activities (walking, running, stair ascent, stair descent, squat) monitoring. The algorithm aims to overcome the limitation of existing gait detection methods that are time-domain thresholding based for steady-state motion and are not versatile to detect gait during different activities or different gait patterns of the same activity. The portable sensing suit is composed of three IMU sensors (wearable sensors for gait phase detection) and two footswitches (ground truth measurement and not needed for gait detection of the proposed algorithm). The acceleration, angular velocity, Euler angle, resultant acceleration, and resultant angular velocity from three IMUs are used as the input training data and the data of two footswitches used as the training label data (single support, double support, swing phase). Three methods 1) Logistic Regression (LR), 2) Random Forest Classifier (RF), and 3) Artificial Neural Network (NN) are used to build the gait phase detection models. The result shows our proposed gait phase detection with Random Forest Classifier can achieve 98.94% accuracy in walking, 98.45% in running, 99.15% in stair-ascent, 99.00% in stair-descent, and 99.63% in squatting. It demonstrates that our sensing suit can not only detect the gait status in any transient state but also generalize to multiple activities. Therefore, it can be implemented in real-time monitoring of human gait and control of assistive devices. 
    more » « less
  2. Objective: Accurate implementation of real-time non-invasive Brain-Machine / Computer Interfaces (BMI / BCI) requires handling physiological and non-physiological artifacts associated with the measurement modalities. For example, scalp electroencephalographic (EEG) measurements are often considered prone to excessive motion artifacts and other types of artifacts that contaminate the EEG recordings. Although the magnitude of such artifacts heavily depends on the task and the setup, complete minimization or isolation of such artifacts is generally not possible. Approach: We present an adaptive de-noising framework with robustness properties, using a Volterra based non-linear mapping to characterize and handle the motion artifact contamination in EEG measurements. We asked healthy able-bodied subjects to walk on a treadmill at gait speeds of 1-to-4 mph, while we tracked the motion of select EEG electrodes with an infrared video-based motion tracking system. We also placed Inertial Measurement Unit (IMU) sensors on the forehead and feet of the subjects for assessing the overall head movement and segmenting the gait. Main Results: We discuss in detail the characteristics of the motion artifacts and propose a real-time compatible solution to filter them. We report the effective handling of both the fundamental frequency of contamination (synchronized to the walking speed) and its harmonics. Event-Related Spectral Perturbation (ERSP) analysis for walking shows that the gait dependency of artifact contamination is also eliminated on all target frequencies. Significance: The real-time compatibility and generalizability of our adaptive filtering framework allows for the effective use of non-invasive BMI/BCI systems and greatly expands the implementation type and application domains to other types of problems where signal denoising is desirable. Combined with our previous efforts of filtering ocular artifacts, the presented technique allows for a comprehensive adaptive filtering framework to increase the EEG Signal to Noise Ratio (SNR). We believe the implementation will benefit all non-invasive neural measurement modalities, including studies discussing neural correlates of movement and other internal states, not necessarily of BMI focus. 
    more » « less
  3. Detection of the user’s walking is a critical part of exoskeleton technology for the full automation of smooth and seamless assistance during movement transitions. Researchers have taken several approaches in developing a walk detection system by using different kinds of sensors; however, only a few solutions currently exist which can detect these transitions using only the sensors embedded on a robotic hip exoskeleton (i.e., hip encoders and a trunk IMU), which is a critical consideration for implementing these systems in-the-loop of a hip exoskeleton controller. As a solution, we explored and developed two walk detection models that implemented a finite state machine as the models switched between walking and standing states using two transition conditions: stand-to-walk and walk-to-stand. One of our models dynamically detected the user’s gait cycle using two hip encoders and an IMU; the other model only used the two hip encoders. Our models were developed using a publicly available dataset and were validated online using a wearable sensor suite that contains sensors commonly embedded on robotic hip exoskeletons. The two models were then compared with a foot contact estimation method, which served as a baseline for evaluating our models. The results of our online experiments validated the performance of our models, resulting in 274 ms and 507 ms delay time when using the HIP+IMU and HIP ONLY model, respectively. Therefore, the walk detection models established in our study achieve reliable performance under multiple locomotive contexts without the need for manual tuning or sensors additional to those commonly implemented on robotic hip exoskeletons. 
    more » « less
  4. Various factors are responsible for injuries that occur in the U.S. Army soldiers. In particular, rucksack load carriage equipment influences the stability of the lower extremities and possibly affects gait balance. The objective of this investigation was to assess the gait and local dynamic stability of the lower extremity of five subjects as they performed a simulated rucksack march on a treadmill. The Motek Gait Real-time Interactive Laboratory (GRAIL) was utilized to replicate the environment of the rucksack march. The first walking trial was without a rucksack and the second set was executed with the All-Purpose Lightweight Individual Carrying Equipment (ALICE), an older version of the rucksack, and the third set was executed with the newer rucksack version, Modular Lightweight Load Carrying Equipment (MOLLE). In this experiment, the Inertial Measurement Unit (IMU) system, Dynaport was used to measure the ambulatory data of the subject. This experiment required subjects to walk continuously for 200 seconds with a 20kg rucksack, which simulates the real rucksack march training. To determine the dynamic stability of different load carriage and normal walking condition, Local Dynamic Stability (LDS) was calculated to quantify its stability. The results presented that comparing Maximum Lyapunov Exponent (LyE) of normal walking was significantly lower compared to ALICE (P=0.000007) and MOLLE (P=0.00003), however, between ALICE and MOLLE rucksack walking showed no significant difference (P=0.441). The five subjects showed significantly improved dynamic stability when walking without a rucksack in comparison with wearing the equipment. In conclusion, we discovered wearing a rucksack result in a significant (P < 0.0001) reduction in dynamic stability. 
    more » « less
  5. Senior citizens, young children, and people with age-related diseases, often find it hard to express themselves. They are not fully aware of their need for help, or how to ask for assistance. This lack of awareness decreases the quality of life, and even endangers those individuals.IC-SAFE (Intelligent Connected Sensing Approaches for the Elderly) tracks the safety of the elderly by using various connected smart wearable sensors. IC-SAFE collects motion data, including walking gaits, arm and leg tremors, and long lounging positions, from many lightweight body sensors to identify the safety status (both physical and emotional) of dementia patients. Feasibility tests have been performed using IMU (Inertial Measurement Unit) sensors in various positions and data from these experiments has been gathered. We have proposed efficient real-time algorithms using analytical learning methods and identified several safety target scenarios by analyzing the corresponding gait data. 
    more » « less