An official website of the United States government
Physical interaction with tools is ubiquitous in functional activities of daily living. While tool use is considered a hallmark of human behavior, how humans control such physical interactions is still poorly understood. When humans perform a motor task, it is commonly suggested that the central nervous system coordinates the musculo-skeletal system to minimize muscle effort. In this paper, we tested if this notion holds true for motor tasks that involve physical interaction. Specifically, we investigated whether humans minimize muscle forces to control physical interaction with a circular kinematic constraint. Using a simplified arm model, we derived three predictions for how humans should behave if they were minimizing muscular effort to perform the task. First, we predicted that subjects would exert workless, radial forces on the constraint. Second, we predicted that the muscles would be deactivated when they could not contribute to work. Third, we predicted that when moving very slowly along the constraint, the pattern of muscle activity would not differ between clockwise (CW) and counterclockwise (CCW) motions. To test these predictions, we instructed human subjects to move a robot handle around a virtual, circular constraint at a constant tangential velocity. To reduce the effect of forces that might arise from incomplete compensation of neuro-musculo-skeletal dynamics, the target tangential speed was set to an extremely slow pace (~1 revolution every 13.3 seconds). Ultimately, the results of human experiment did not support the predictions derived from our model of minimizing muscular effort. While subjects did exert workless forces, they did not deactivate muscles as predicted. Furthermore, muscle activation patterns differed between CW and CCW motions about the constraint. These findings demonstrate that minimizing muscle effort is not a significant factor in human performance of this constrained-motion task. Instead, the central nervous system likely prioritizes reducing other costs, such as computational effort, over muscle effort to control physical interactions.
more »
« less
A Recurrent Neural Network Enhanced Unscented Kalman Filter for Human Motion Prediction
Abstract This paper presents a deep learning enhanced adaptive unscented Kalman filter (UKF) for predicting human arm motion in the context of manufacturing. Unlike previous network-based methods that solely rely on captured human motion data, which is represented as bone vectors in this paper, we incorporate a human arm dynamic model into the motion prediction algorithm and use the UKF to iteratively forecast human arm motions. Specifically, a Lagrangian-mechanics-based physical model is employed to correlate arm motions with associated muscle forces. Then a Recurrent Neural Network (RNN) is integrated into the framework to predict future muscle forces, which are transferred back to future arm motions based on the dynamic model. Given the absence of measurement data for future human motions that can be input into the UKF to update the state, we integrate another RNN to directly predict human future motions and treat the prediction as surrogate measurement data fed into the UKF. A noteworthy aspect of this study involves the quantification of uncertainties associated with both the data-driven and physical models in one unified framework. These quantified uncertainties are used to dynamically adapt the measurement and process noises of the UKF over time. This adaption, driven by the uncertainties of the RNN models, addresses inaccuracies stemming from the data-driven model and mitigates discrepancies between the assumed and true physical models, ultimately enhancing the accuracy and robustness of our predictions. One unique point of our method is that it integrates a dynamic model of human arms and two RNN models, and uses Monte Carlo dropout sampling to quantify the uncertainties inherent in our RNN prediction models and transforms them into the covariances of the UKF’s measurement and process noises respectively. Compared to the traditional RNN-based prediction, our method demonstrates improved accuracy and robustness in extensive experimental validations of various types of human motions.
more »
« less
- PAR ID:
- 10544012
- Publisher / Repository:
- American Society of Mechanical Engineers
- Date Published:
- ISBN:
- 978-0-7918-8788-2
- Format(s):
- Medium: X
- Location:
- Seattle, Washington, USA
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Physical interaction with tools is ubiquitous in functional activities of daily living. While tool use is considered a hallmark of human behavior, how humans control such physical interactions is still poorly understood. When humans perform a motor task, it is commonly suggested that the central nervous system coordinates the musculo-skeletal system to minimize muscle effort. In this paper, we tested if this notion holds true for motor tasks that involve physical interaction. Specifically, we investigated whether humans minimize muscle forces to control physical interaction with a circular kinematic constraint. Using a simplified arm model, we derived three predictions for how humans should behave if they were minimizing muscular effort to perform the task. First, we predicted that subjects would exert workless, radial forces on the constraint. Second, we predicted that the muscles would be deactivated when they could not contribute to work. Third, we predicted that when moving very slowly along the constraint, the pattern of muscle activity would not differ between clockwise (CW) and counterclockwise (CCW) motions. To test these predictions, we instructed human subjects to move a robot handle around a virtual, circular constraint at a constant tangential velocity. To reduce the effect of forces that might arise from incomplete compensation of neuro-musculo-skeletal dynamics, the target tangential speed was set to an extremely slow pace (~1 revolution every 13.3 seconds). Ultimately, the results of human experiment did not support the predictions derived from our model of minimizing muscular effort. While subjects did exert workless forces, they did not deactivate muscles as predicted. Furthermore, muscle activation patterns differed between CW and CCW motions about the constraint. These findings demonstrate that minimizing muscle effort is not a significant factor in human performance of this constrained-motion task. Instead, the central nervous system likely prioritizes reducing other costs, such as computational effort, over muscle effort to control physical interactions.more » « less
-
Physical interaction with tools is ubiquitous in functional activities of daily living. While tool use is considered a hallmark of human behavior, how humans control such physical interactions is still poorly understood. When humans perform a motor task, it is commonly suggested that the central nervous system coordinates the musculo-skeletal system to minimize muscle effort. In this paper, we tested if this notion holds true for motor tasks that involve physical interaction. Specifically, we investigated whether humans minimize muscle forces to control physical interaction with a circular kinematic constraint. Using a simplified arm model, we derived three predictions for how humans should behave if they were minimizing muscular effort to perform the task. First, we predicted that subjects would exert workless, radial forces on the constraint. Second, we predicted that the muscles would be deactivated when they could not contribute to work. Third, we predicted that when moving very slowly along the constraint, the pattern of muscle activity would not differ between clockwise (CW) and counterclockwise (CCW) motions. To test these predictions, we instructed human subjects to move a robot handle around a virtual, circular constraint at a constant tangential velocity. To reduce the effect of forces that might arise from incomplete compensation of neuro-musculo-skeletal dynamics, the target tangential speed was set to an extremely slow pace (~1 revolution every 13.3 seconds). Ultimately, the results of human experiment did not support the predictions derived from our model of minimizing muscular effort. While subjects did exert workless forces, they did not deactivate muscles as predicted. Furthermore, muscle activation patterns differed between CW and CCW motions about the constraint. These findings demonstrate that minimizing muscle effort is not a significant factor in human performance of this constrained-motion task. Instead, the central nervous system likely prioritizes reducing other costs, such as computational effort, over muscle effort to control physical interactions.more » « less
-
Physical interaction with tools is ubiquitous in functional activities of daily living. While tool use is considered a hallmark of human behavior, how humans control such physical interactions is still poorly understood. When humans perform a motor task, it is commonly suggested that the central nervous system coordinates the musculo-skeletal system to minimize muscle effort. In this paper, we tested if this notion holds true for motor tasks that involve physical interaction. Specifically, we investigated whether humans minimize muscle forces to control physical interaction with a circular kinematic constraint. Using a simplified arm model, we derived three predictions for how humans should behave if they were minimizing muscular effort to perform the task. First, we predicted that subjects would exert workless, radial forces on the constraint. Second, we predicted that the muscles would be deactivated when they could not contribute to work. Third, we predicted that when moving very slowly along the constraint, the pattern of muscle activity would not differ between clockwise (CW) and counterclockwise (CCW) motions. To test these predictions, we instructed human subjects to move a robot handle around a virtual, circular constraint at a constant tangential velocity. To reduce the effect of forces that might arise from incomplete compensation of neuro-musculo-skeletal dynamics, the target tangential speed was set to an extremely slow pace (~1 revolution every 13.3 seconds). Ultimately, the results of human experiment did not support the predictions derived from our model of minimizing muscular effort. While subjects did exert workless forces, they did not deactivate muscles as predicted. Furthermore, muscle activation patterns differed between CW and CCW motions about the constraint. These findings demonstrate that minimizing muscle effort is not a significant factor in human performance of this constrained-motion task. Instead, the central nervous system likely prioritizes reducing other costs, such as computational effort, over muscle effort to control physical interactions.more » « less
-
In this study, a novel human-in-the-loop design method using a genetic algorithm (GA) is presented to design a low-cost and easy-to-use four-bar linkage medical device for upper limb muscle rehabilitation. The four-bar linkage can generate a variety of coupler point trajectories by using different link lengths. For this medical device, patients grab the coupler point handle and rotate the arm along the designed coupler point trajectory to exercise upper limb muscles. The design procedures include three basic steps: First, for a set of link lengths, a complete coupler point trajectory is generated from four-bar linkage kinematics; second, optimization-based motion prediction is utilized to predict arm motion (joint angle profiles) subjected to hand grasping and joint angle limit constraints; third, the predicted joint angles and given hand forces are imported into an OpenSim musculoskeletal arm model to calculate the muscle forces and activations by using the OpenSim static optimization. In the GA optimization formulation, the design variables are the four-bar link lengths. The objective function is to maximize a specific muscle’s exertion for a complete arm rotation. Finally, different four-bar configurations are designed for different muscle strength exercises. The proposed human-in-the-loop design approach successfully integrates GA with linkage kinematics, arm motion prediction, and OpenSim static optimization for four-bar linkage design for upper limb muscle strength rehabilitation.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1115/ISFA2024-141304
