skip to main content


The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 11:00 PM ET on Thursday, May 23 until 2:00 AM ET on Friday, May 24 due to maintenance. We apologize for the inconvenience.

Title: Wearable Motion and Force Sensing to Determine Force Exertion and Task Recognition for Ergonomic Analysis
Work-related musculoskeletal disorders contribute to significant loss in productivity and higher costs for employers. This research utilizes body-worn motion and hand-worn force sensors to provide non-intrusive and continuous recognition of tasks, estimate force exertion, and evaluate if operators are working in safe ergonomic ranges. Work-related motions such as lifting, carrying, pulling, and pushing are measured with varied loads up to 10 kg, and then recognized performed using the IBM Watson cloud service platform. The experiments use sequential and quasi-static postures and mimic those commonly found in an automotive assembly environment. Classification performance included generating 70 input features based on 6 motion and 4 force inputs and three of the resulting classifier had a greater than 90% accuracy in simultaneously classifying both the weight being carried and the task being completed. Future work includes measuring non-quasi-static motions and integrating additional sensors, such as those from smart tooling, which tracks tool position and orientation, to provide a continuous and unobtrusive evaluation of worker exertion and risk of musculoskeletal disorder.  more » « less
Award ID(s):
Author(s) / Creator(s):
K. Ellis, W. Ferrell
Date Published:
Journal Name:
Proceedings of the IISE Annual Conference & Expo
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Monitoring human gait is essential to quantify gait issues associated with fall-prone individuals as well as other gait-related movement disorders. Being portable and cost-effective, ambulatory gait analysis using inertial sensors is considered a promising alternative to traditional laboratory-based approach. The current study aimed to provide a method for predicting the spatio-temporal gait parameters using the wrist-worn inertial sensors. Eight young adults were involved in a laboratory study. Optical motion analysis system and force-plates were used for the assessment of baseline gait parameters. Spatio-temporal features of an Inertial Measurement Unit (IMU) on the wrist were analyzed. Multi-variate correlation analyses were performed to develop gait parameter prediction models. The results indicated that gait stride time was strongly correlated with peak-to-peak duration of wrist gyroscope signal in the anterio-posterior direction. Meanwhile, gait stride length was successfully predicted using a combination model of peak resultant wrist acceleration and peak sagittal wrist angle. In conclusion, current study provided the evidence that the wrist-worn inertial sensors are capable of estimating spatio-temporal gait parameters. This finding paves the foundation for developing a wrist-worn gait monitor with high user compliance. 
    more » « less
  2. Radar-based solutions support practical and longi- tudinal respiration monitoring owing to their non-invasive nature. Nighttime respiration monitoring at home provides rich and high- quality data, mostly free of motion disturbances because the user is quasi-stationary during sleep, and 6-8 hours per day rather than tens of minutes, promising for longitudinal studies. However, most existing work was conducted in laboratory environments for short periods, thus the environment, user motions, and postures can differ significantly from those in real homes. To understand how to obtain quality, overnight respiration data in real homes, we conduct a thorough experimental study with 6 participants of various sleep postures over 9 nights in 4 real-home testbeds, each configured with 3–4 sensors around the bed. We first compare the performance among four typical sensor placements around the bed to understand which is the optimal location for high quality data. Then we explore methods to track range bins with high quality signals as occasional user motions change the distance thus signal qualities, and different aspects of amplitude and phase data to further improve the signal quality using metrics of the periodicity-to-noise ratio (PNR) and end-to-end (e2e) accuracy. The experiments demonstrate that the sensor placement is a vital factor, and the bedside is an optimal choice considering both accuracy and ease of deployment (2.65 bpm error at 80 percentile), also consistent among four typical sleep postures. We also observe that, a proper range bin selection method can improve the PNR by 2 dB at 75-percentile, and e2e accuracy by 0.9 bpm at 80-percentile. Both amplitude and phase data have comparable e2e accuracy, while phase is more sensitive to motions thus suitable for nighttime movement detection. Based on these discoveries, we develop a few simple practical guidelines useful for the community to achieve high quality, longitudinal home- based overnight respiration monitoring. 
    more » « less
  3. Morales, Marco ; Tapia, Lydia ; Sanchez-Ante, Gildardo ; Hutchinson, Seth (Ed.)
    Quasi-static models of robotic motion with frictional contact provide a computationally efficient framework for analysis and have been widely used for planning and control of non-prehensile manipulation. In this work, we present a novel quasi-static model of planar manipulation that directly maps commanded manipulator velocities to object motion. While quasi-static models have traditionally been unable to capture grasping and jamming behaviors, our approach solves this issue by explicitly modeling the limiting behavior of a velocity-controlled manipulator. We retain the precise modeling of surface contact pressure distributions and efficient computation of contact-rich behaviors of previous methods and additionally prove existence of solutions for any desired manipulator motion. We derive continuous and time-stepping formulations, both posed as tractable Linear Complementarity Problems (LCPs). 
    more » « less
  4. Goal: Lifting is a common manual material handling task performed in the workplaces. It is considered as one of the main risk factors for work-related musculoskeletal disorders. An important criterion to identify the unsafe lifting task is the values of the net force and moment at L5/S1 joint. These values are mainly calculated in a laboratory environment, which utilizes marker-based sensors to collect three-dimensional (3-D) information and force plates to measure the external forces and moments. However, this method is usually expensive to set up, time-consuming in process, and sensitive to the surrounding environment. In this study, we propose a deep neural network (DNN)-based framework for 3-D pose estimation, which addresses the aforementioned limitations, and we employ the results for L5/S1 moment and force calculation. Methods: At the first step of the proposed framework, full body 3-D pose is captured using a DNN, then at the second step, estimated 3-D body pose along with the subject's anthropometric information is utilized to calculate L5/S1 join's kinetic by a top-down inverse dynamic algorithm. Results: To fully evaluate our approach, we conducted experiments using a lifting dataset consisting of 12 subjects performing various types of lifting tasks. The results are validated against a marker-based motion capture system as a reference. The grand mean ± SD of the total moment/force absolute errors across all the dataset was 9.06 ± 7.60 N·m/4.85 ± 4.85 N. Conclusion: The proposed method provides a reliable tool for assessment of the lower back kinetics during lifting and can be an alternative when the use of marker-based motion capture systems is not possible. 
    more » « less
  5. mmWave signals form a critical component of 5G and next-generation wireless networks, which are also being increasingly considered for sensing the environment around us to enable ubiquitous IoT applications. In this context, this paper leverages the properties of mmWave signals for tracking 3D finger motion for interactive IoT applications. While conventional vision-based solutions break down under poor lighting, occlusions, and also suffer from privacy concerns, mmWave signals work under typical occlusions and non-line-of-sight conditions, while being privacy-preserving. In contrast to prior works on mmWave sensing that focus on predefined gesture classification, this work performs continuous 3D finger motion tracking. Towards this end, we first observe via simulations and experiments that the small size of fingers coupled with specular reflections do not yield stable mmWave reflections. However, we make an interesting observation that focusing on the forearm instead of the fingers can provide stable reflections for 3D finger motion tracking. Muscles that activate the fingers extend through the forearm, whose motion manifests as vibrations on the forearm. By analyzing the variation in phases of reflected mmWave signals from the forearm, this paper designs mm4Arm, a system that tracks 3D finger motion. Nontrivial challenges arise due to the high dimensional search space, complex vibration patterns, diversity across users, hardware noise, etc. mm4Arm exploits anatomical constraints in finger motions and fuses them with machine learning architectures based on encoder-decoder and ResNets in enabling accurate tracking. A systematic performance evaluation with 10 users demonstrates a median error of 5.73° (location error of 4.07 mm) with robustness to multipath and natural variation in hand position/orientation. The accuracy is also consistent under non-line-of-sight conditions and clothing that might occlude the forearm. mm4Arm runs on smartphones with a latency of 19 ms and low energy overhead. 
    more » « less