Dexterous manipulation relies on the ability to simultaneously attain two goals: controlling object position and orientation (pose) and preventing object slip. Although object manipulation has been extensively studied, most previous work has focused only on the control of digit forces for slip prevention. Therefore, it remains underexplored how humans coordinate digit forces to prevent object slip and control object pose simultaneously. We developed a dexterous manipulation task requiring subjects to grasp and lift a sensorized object using different grasp configurations while preventing it from tilting. We decomposed digit forces into manipulation and grasp forces for pose control and slip prevention, respectively. By separating biomechanically-obligatory from non-obligatory effects of grasp configuration, we found that subjects prioritized grasp stability over efficiency in grasp force control. Furthermore, grasp force was controlled in an anticipatory fashion at object lift onset, whereas manipulation force was modulated following acquisition of somatosensory and visual feedback of object’s dynamics throughout object lift. Mathematical modeling of feasible manipulation forces further confirmed that subjects could not accurately anticipate the required manipulation force prior to acquisition of sensory feedback. Our experimental approach and findings open new research avenues for investigating neural mechanisms underlying dexterous manipulation and biomedical applications.
- Award ID(s):
- 1827725
- NSF-PAR ID:
- 10448672
- Date Published:
- Journal Name:
- Journal of Neurophysiology
- Volume:
- 129
- Issue:
- 2
- ISSN:
- 0022-3077
- Page Range / eLocation ID:
- 380 to 391
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
Abstract -
Trial-and-error motor adaptation has been linked to somatosensory plasticity and shifts in proprioception (limb position sense). The role of sensory processing in motor skill learning is less understood. Unlike adaptation, skill learning involves the acquisition of new movement patterns in the absence of perturbation, with performance limited by the speed-accuracy tradeoff. We investigated somatosensory changes during motor skill learning at the behavioral and neurophysiological level. Twenty-eight healthy young adults practiced a maze-tracing task, guiding a robotic manipulandum through an irregular 2D track featuring several abrupt turns. Practice occurred on days 1 and 2. Skill was assessed before practice on day 1 and again on day 3, with learning indicated by a shift in the speed-accuracy function between these assessments. Proprioceptive function was quantified with a passive two-alternative forced choice task. In a subset of 15 participants, we measured short latency afferent inhibition (SAI) to index somatosensory projections to motor cortex. We found that motor practice enhanced the speed-accuracy skill function (F 4,108 = 32.15, p < 0.001) and was associated with improved proprioceptive sensitivity at retention (t 22 = 24.75, p = 0.0031). Further, SAI increased after training (F 1,14 = 5.41, p = 0.036). Interestingly, individuals with larger increases in SAI, reflecting enhanced somatosensory afference to motor cortex, demonstrated larger improvements in motor skill learning. These findings suggest that SAI may be an important functional mechanism for some aspect of motor skill learning. Further research is needed to test what parameters (task complexity, practice time, etc) are specifically linked to somatosensory function.more » « less
-
more » « less
Dynamic adaptation is an error-driven process of adjusting planned motor actions to changes in task dynamics (Shadmehr, 2017). Adapted motor plans are consolidated into memories that contribute to better performance on re-exposure. Consolidation begins within 15 min following training (Criscimagna-Hemminger and Shadmehr, 2008), and can be measured via changes in resting state functional connectivity (rsFC). For dynamic adaptation, rsFC has not been quantified on this timescale, nor has its relationship to adaptative behavior been established. We used a functional magnetic resonance imaging (fMRI)-compatible robot, the MR-SoftWrist (Erwin et al., 2017), to quantify rsFC specific to dynamic adaptation of wrist movements and subsequent memory formation in a mixed-sex cohort of human participants. We acquired fMRI during a motor execution and a dynamic adaptation task to localize brain networks of interest, and quantified rsFC within these networks in three 10-min windows occurring immediately before and after each task. The next day, we assessed behavioral retention. We used a mixed model of rsFC measured in each time window to identify changes in rsFC with task performance, and linear regression to identify the relationship between rsFC and behavior. Following the dynamic adaptation task, rsFC increased within the cortico-cerebellar network and decreased interhemispherically within the cortical sensorimotor network. Increases within the cortico-cerebellar network were specific to dynamic adaptation, as they were associated with behavioral measures of adaptation and retention, indicating that this network has a functional role in consolidation. Instead, decreases in rsFC within the cortical sensorimotor network were associated with motor control processes independent from adaptation and retention.
SIGNIFICANCE STATEMENT Motor memory consolidation processes have been studied via functional magnetic resonance imaging (fMRI) by analyzing changes in resting state functional connectivity (rsFC) occurring more than 30 min after adaptation. However, it is unknown whether consolidation processes are detectable immediately (<15 min) following dynamic adaptation. We used an fMRI-compatible wrist robot to localize brain regions involved in dynamic adaptation in the cortico-thalamic-cerebellar (CTC) and cortical sensorimotor networks and quantified changes in rsFC within each network immediately after adaptation. Different patterns of change in rsFC were observed compared with studies conducted at longer latencies. Increases in rsFC in the cortico-cerebellar network were specific to adaptation and retention, while interhemispheric decreases in the cortical sensorimotor network were associated with alternate motor control processes but not with memory formation. -
more » « less
Abstract Background Muscle synergies, computationally identified intermuscular coordination patterns, have been utilized to characterize neuromuscular control and learning in humans. However, it is unclear whether it is possible to alter the existing muscle synergies or develop new ones in an intended way through a relatively short-term motor exercise in adulthood. This study aimed to test the feasibility of expanding the repertoire of intermuscular coordination patterns through an isometric, electromyographic (EMG) signal-guided exercise in the upper extremity (UE) of neurologically intact individuals.
Methods 10 participants were trained for six weeks to induce independent control of activating a pair of elbow flexor muscles that tended to be naturally co-activated in force generation. An untrained isometric force generation task was performed to assess the effect of the training on the intermuscular coordination of the trained UE. We applied a non-negative matrix factorization on the EMG signals recorded from 12 major UE muscles during the assessment to identify the muscle synergies. In addition, the performance of training tasks and the characteristics of individual muscles’ activity in both time and frequency domains were quantified as the training outcomes.
Results Typically, in two weeks of the training, participants could use newly developed muscle synergies when requested to perform new, untrained motor tasks by activating their UE muscles in the trained way. Meanwhile, their habitually expressed muscle synergies, the synergistic muscle activation groups that were used before the training, were conserved throughout the entire training period. The number of muscle synergies activated for the task performance remained the same. As the new muscle synergies were developed, the neuromotor control of the trained muscles reflected in the metrics, such as the ratio between the targeted muscles, number of matched targets, and task completion time, was improved.
Conclusion These findings suggest that our protocol can increase the repertoire of readily available muscle synergies and improve motor control by developing the activation of new muscle coordination patterns in healthy adults within a relatively short period. Furthermore, the study shows the potential of the isometric EMG-guided protocol as a neurorehabilitation tool for aiming motor deficits induced by abnormal intermuscular coordination after neurological disorders.
Trial registration This study was registered at the Clinical Research Information Service (CRiS) of the Korea National Institute of Health (KCT0005803) on 1/22/2021.
-
more » « less
Background In Physical Human–Robot Interaction (pHRI), the need to learn the robot’s motor-control dynamics is associated with increased cognitive load. Eye-tracking metrics can help understand the dynamics of fluctuating mental workload over the course of learning.
Objective The aim of this study was to test eye-tracking measures’ sensitivity and reliability to variations in task difficulty, as well as their performance-prediction capability, in physical human–robot collaboration tasks involving an industrial robot for object comanipulation.
Methods Participants (9M, 9F) learned to coperform a virtual pick-and-place task with a bimanual robot over multiple trials. Joint stiffness of the robot was manipulated to increase motor-coordination demands. The psychometric properties of eye-tracking measures and their ability to predict performance was investigated.
Results Stationary Gaze Entropy and pupil diameter were the most reliable and sensitive measures of workload associated with changes in task difficulty and learning. Increased task difficulty was more likely to result in a robot-monitoring strategy. Eye-tracking measures were able to predict the occurrence of success or failure in each trial with 70% sensitivity and 71% accuracy.
Conclusion The sensitivity and reliability of eye-tracking measures was acceptable, although values were lower than those observed in cognitive domains. Measures of gaze behaviors indicative of visual monitoring strategies were most sensitive to task difficulty manipulations, and should be explored further for the pHRI domain where motor-control and internal-model formation will likely be strong contributors to workload.
Application Future collaborative robots can adapt to human cognitive state and skill-level measured using eye-tracking measures of workload and visual attention.
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1152/jn.00329.2022
