skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Toward Real-Time Detection of Object Lifting Using Wearable Inertial Measurement Units
Back injuries and other occupational injuries are common in workers who engage in long, arduous physical labor. The risk of these injuries could be reduced using assistive devices that automatically detect an object lifting motion and support the user while they perform the lift; however, such devices must be able to detect the lifting motion as it occurs. We thus developed a system to detect the start and end of a lift (performed as a stoop or squat) in real time based on pelvic angle and the distance between the user's hands and the user's center of mass. The measurements were input to an algorithm that first searches for hand-center distance peaks in a sliding window, then checks the pelvic displacement angle to verify lift occurrence. The approach was tested with 5 participants, who performed a total of 100 lifts of four different types. The times of actual lifts were determined by manual video annotation. The median time error (absolute difference between detected and actual occurrence time) for lifts that were not false negatives was 0.11 s; a lift was considered a false negative if it was not detected within two seconds of it actually occurring. Furthermore, 95% of lifts that were detected occurred within 0.28 s of actual occurrence. This shows that it is possible to reliably detect lifts in real time based on the pelvic displacement angle and the distance between the user's hands and their center of mass.  more » « less
Award ID(s):
2151465
PAR ID:
10313189
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Proceedings of the 43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Although several studies have used wearable sensors to analyze human lifting, this has generally only been done in a limited manner. In this proof-of-concept study, we investigate multiple aspects of offline lift characterization using wearable inertial measurement sensors: detecting the start and end of the lift and classifying the vertical movement of the object, the posture used, the weight of the object, and the asymmetry involved. In addition, the lift duration, horizontal distance from the lifter to the object, the vertical displacement of the object, and the asymmetric angle are computed as lift parameters. Twenty-four healthy participants performed two repetitions of 30 different main lifts each while wearing a commercial inertial measurement system. The data from these trials were used to develop, train, and evaluate the lift characterization algorithms presented. The lift detection algorithm had a start time error of 0.10 s ± 0.21 s and an end time error of 0.36 s ± 0.27 s across all 1489 lift trials with no missed lifts. For posture, asymmetry, vertical movement, and weight, our classifiers achieved accuracies of 96.8%, 98.3%, 97.3%, and 64.2%, respectively, for automatically detected lifts. The vertical height and displacement estimates were, on average, within 25 cm of the reference values. The horizontal distances measured for some lifts were quite different than expected (up to 14.5 cm), but were very consistent. Estimated asymmetry angles were similarly precise. In the future, these proof-of-concept offline algorithms can be expanded and improved to work in real-time. This would enable their use in applications such as real-time health monitoring and feedback for assistive devices. 
    more » « less
  2. null (Ed.)
    Abstract Lifting heavy weight is one of the main reasons for manual material handling related injuries which can be mitigated by determining the limiting lifting weight of a person. In this study, a 40 degrees of freedom (DOFs) spatial skeletal model was employed to predict the symmetric maximum weight lifting motion. The lifting problem was formulated as a multi-objective optimization (MOO) problem to minimize the dynamic effort and maximize the box weight. An inverse-dynamics-based optimization approach was used to determine the optimal lifting motion and the maximum lifting weight considering dynamic joint strength. The predicted lifting motion, ground reaction forces (GRFs), and maximum box weight were shown to match well with the experimental results. It was found that for the three-dimensional (3D) symmetric lifting the left and right GRFs were not same. 
    more » « less
  3. ObjectiveTo identify lifting actions and count the number of lifts performed in videos based on robust class prediction and a streamlined process for reliable real-time monitoring of lifting tasks. BackgroundTraditional methods for recognizing lifting actions often rely on deep learning classifiers applied to human motion data collected from wearable sensors. Despite their high performance, these methods can be difficult to implement on systems with limited hardware resources. MethodThe proposed method follows a five-stage process: (1) BlazePose, a real-time pose estimation model, detects key joints of the human body. (2) These joints are preprocessed by smoothing, centering, and scaling techniques. (3) Kinematic features are extracted from the preprocessed joints. (4) Video frames are classified as lifting or nonlifting using rank-altered kinematic feature pairs. (5) A lifting counting algorithm counts the number of lifts based on the class predictions. ResultsNine rank-altered kinematic feature pairs are identified as key pairs. These pairs were used to construct an ensemble classifier, which achieved 0.89 or above in classification metrics, including accuracy, precision, recall, and F1 score. This classifier showed an accuracy of 0.90 in lifting counting and a latency of 0.06 ms, which is at least 12.5 times faster than baseline classifiers. ConclusionThis study demonstrates that computer vision-based kinematic features could be adopted to effectively and efficiently recognize lifting actions. ApplicationThe proposed method could be deployed on various platforms, including mobile devices and embedded systems, to monitor lifting tasks in real-time for the proactive prevention of work-related low-back injuries. 
    more » « less
  4. Background Context: Pelvic ring fractures are becoming more common in the aging population and can prove to be fatal, having mortality rates between 10% and 16%. Stabilization of these fractures is challenging and often require immediate internal fixation. Therefore, it is necessary to have a biomechanical understanding of the different fixation techniques for pelvic ring fractures. Methods: A previously validated three-dimensional finite element model of the lumbar spine, pelvis, and femur was used for this study. A unilateral pelvic ring fracture was simulated by resecting the left side of the sacrum and pelvis. Five different fixation techniques were used to stabilize the fracture. A compressive follower load and pure moment was applied to compare different biomechanical parameters including range of motion (contralateral sacroiliac joint, L1-S1 segment, L5-S1 segment), and stresses (L5-S1 nucleus stresses, instrument stresses) between different fixation techniques. Results: Trans-iliac–trans-sacral screw fixation at S1 and S2 showed the highest stabilization for horizontal and vertical displacement at the sacral fracture site and reduction of contralateral sacroiliac joint for bending and flexion range of motion by 165% and 121%, respectively. DTSF (Double transiliac rod and screw fixation) model showed highest stabilization in horizontal displacement at the pubic rami fracture site, while the L5_PF_W_CC (L5-Ilium posterior screw fixation with cross connectors) and L5_PF_WO_CC (L5-Ilium posterior screw fixation without cross connectors) showed higher rod stresses, reduced L1-S1 (approximately 28%), and L5-S1 (approximately 90%) range of motion. Conclusions: Longer sacral screw fixations were superior in stabilizing sacral and contralateral sacroiliac joint range of motion. Lumbopelvic fixations displayed a higher degree of stabilization in the horizontal displacement compared to vertical displacement of pubic rami fracture, while also indicating the highest rod stresses. When determining the surgical approach for pelvic ring fractures, patient-specific factors should be accounted for to weigh the advantages and disadvantages for each technique. 
    more » « less
  5. Abstract In this study, a hybrid predictive model is used to predict 3D asymmetric lifting motion and assess potential musculoskeletal lower back injuries for asymmetric lifting tasks. The hybrid model has two modules: a skeletal module and an OpenSim musculoskeletal module. The skeletal module consists of a dynamic joint strength based 40 degrees of freedom spatial skeletal model. The skeletal module can predict the lifting motion, ground reaction forces (GRFs), and center of pressure (COP) trajectory using an inverse dynamics based optimization method. The equations of motion are built by recursive Lagrangian dynamics. The musculoskeletal module consists of a 324-muscle-actuated full-body lumbar spine model. Based on the generated kinematics, GRFs and COP data from the skeletal module, the musculoskeletal module estimates muscle activations using static optimization and joint reaction forces through the joint reaction analysis tool. Muscle activation results between simulated and experimental EMG are compared to validate the model. Finally, potential lower back injuries are evaluated for a specific-weight asymmetric lifting task. The shear and compression spine loads are compared to NIOSH recommended limits. At the beginning of the dynamic lifting process, the simulated compressive spine load beyond the NIOSH action limit but less than the permissible limit. This is due to the fatigue factors considered in NIOSH lifting equation. 
    more » « less