An official website of the United States government
The hypothesis that the central nervous system (CNS) makes use of synergies or movement primitives in achieving simple to complex movements has inspired the investigation of different types of synergies. Kinematic and muscle synergies have been extensively studied in the literature, but only a few studies have compared and combined both types of synergies during the control and coordination of the human hand. In this paper, synergies were extracted first independently (called kinematic and muscle synergies) and then combined through data fusion (called musculoskeletal synergies) from 26 activities of daily living in 22 individuals using principal component analysis (PCA) and independent component analysis (ICA). By a weighted linear combination of musculoskeletal synergies, the recorded kinematics and the recorded muscle activities were reconstructed. The performances of musculoskeletal synergies in reconstructing the movements were compared to the synergies reported previously in the literature by us and others. The results indicate that the musculoskeletal synergies performed better than the synergies extracted without fusion. We attribute this improvement in performance to the musculoskeletal synergies that were generated on the basis of the cross-information between muscle and kinematic activities. Moreover, the synergies extracted using ICA performed better than the synergies extracted using PCA. These musculoskeletal synergies can possibly improve the capabilities of the current methodologies used to control high dimensional prosthetics and exoskeletons.
more »
« less
Reconstructing Synergy-Based Hand Grasp Kinematics from Electroencephalographic Signals
Brain-machine interfaces (BMIs) have become increasingly popular in restoring the lost motor function in individuals with disabilities. Several research studies suggest that the CNS may employ synergies or movement primitives to reduce the complexity of control rather than controlling each DoF independently, and the synergies can be used as an optimal control mechanism by the CNS in simplifying and achieving complex movements. Our group has previously demonstrated neural decoding of synergy-based hand movements and used synergies effectively in driving hand exoskeletons. In this study, ten healthy right-handed participants were asked to perform six types of hand grasps representative of the activities of daily living while their neural activities were recorded using electroencephalography (EEG). From half of the participants, hand kinematic synergies were derived, and a neural decoder was developed, based on the correlation between hand synergies and corresponding cortical activity, using multivariate linear regression. Using the synergies and the neural decoder derived from the first half of the participants and only cortical activities from the remaining half of the participants, their hand kinematics were reconstructed with an average accuracy above 70%. Potential applications of synergy-based BMIs for controlling assistive devices in individuals with upper limb motor deficits, implications of the results in individuals with stroke and the limitations of the study were discussed.
more »
« less
- Award ID(s):
- 2053498
- PAR ID:
- 10429468
- Date Published:
- Journal Name:
- Sensors
- Volume:
- 22
- Issue:
- 14
- ISSN:
- 1424-8220
- Page Range / eLocation ID:
- 5349
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Converging evidence in human and animal models suggests that exogenous stimulation of the motor cortex (M1) elicits responses in the hand with similar modular structure to that found during voluntary grasping movements. The aim of this study was to establish the extent to which modularity in muscle responses to transcranial magnetic stimulation (TMS) to M1 resembles modularity in muscle activation during voluntary hand movements involving finger fractionation. EMG was recorded from eight hand-forearm muscles in nine healthy individuals. Modularity was defined using non-negative matrix factorization to identify low rank approximations (spatial muscle synergies) of the complex activation patterns of EMG data recorded during high density TMS mapping of M1 and voluntary formation of gestures in the American Sign Language alphabet. Analysis of synergies as a set, and individually, revealed greater than chance similarity between those derived from TMS and those derived from voluntary movement. Both datasets included synergies dominated by single intrinsic hand muscles presumably to meet the demand for highly fractionated finger movement. These results suggest a cortical role in combining corticospinal connectivity to individual intrinsic hand muscles with modular mulit-muscle activation via synergies.more » « less
-
Hand gestures are a natural and intuitive form of communication, and integrating this communication method into robotic systems presents significant potential to improve human-robot collaboration. Recent advances in motor neuroscience have focused on replicating human hand movements from synergies also known as movement primitives. Synergies, fundamental building blocks of movement, serve as a potential strategy adapted by the central nervous system to generate and control movements. Identifying how synergies contribute to movement can help in dexterous control of robotics, exoskeletons, prosthetics and extend its applications to rehabilitation. In this paper, 33 static hand gestures were recorded through a single RGB camera and identified in real-time through the MediaPipe framework as participants made various postures with their dominant hand. Assuming an open palm as initial posture, uniform joint angular velocities were obtained from all these gestures. By applying a dimensionality reduction method, kinematic synergies were obtained from these joint angular velocities. Kinematic synergies that explain 98% of variance of movements were utilized to reconstruct new hand gestures using convex optimization. Reconstructed hand gestures and selected kinematic synergies were translated onto a humanoid robot, Mitra, in real-time, as the participants demonstrated various hand gestures. The results showed that by using only few kinematic synergies it is possible to generate various hand gestures, with 95.7% accuracy. Furthermore, utilizing low-dimensional synergies in control of high dimensional end effectors holds promise to enable near-natural human-robot collaboration.more » « less
-
Advances in our understanding of brain function, along with the development of neural interfaces that allow for the monitoring and activation of neurons, have paved the way for brain-machine interfaces (BMIs), which harness neural signals to reanimate the limbs via electrical activation of the muscles or to control extracorporeal devices, thereby bypassing the muscles and senses altogether. BMIs consist of reading out motor intent from the neuronal responses monitored in motor regions of the brain and executing intended movements with bionic limbs, reanimated limbs, or exoskeletons. BMIs also allow for the restoration of the sense of touch by electrically activating neurons in somatosensory regions of the brain, thereby evoking vivid tactile sensations and conveying feedback about object interactions. In this review, we discuss the neural mechanisms of motor control and somatosensation in able-bodied individuals and describe approaches to use neuronal responses as control signals for movement restoration and to activate residual sensory pathways to restore touch. Although the focus of the review is on intracortical approaches, we also describe alternative signal sources for control and noninvasive strategies for sensory restoration.more » « less
-
null (Ed.)Abstract Handedness has been associated with behavioral asymmetries between limbs that suggest specialized function of dominant and non-dominant hand. Whether patterns of muscle co-activation, representing muscle synergies, also differ between the limbs remains an open question. Previous investigations of proximal upper limb muscle synergies have reported little evidence of limb asymmetry; however, whether the same is true of the distal upper limb and hand remains unknown. This study compared forearm and hand muscle synergies between the dominant and non-dominant limb of left-handed and right-handed participants. Participants formed their hands into the postures of the American Sign Language (ASL) alphabet, while EMG was recorded from hand and forearm muscles. Muscle synergies were extracted for each limb individually by applying non-negative-matrix-factorization (NMF). Extracted synergies were compared between limbs for each individual, and between individuals to assess within and across participant differences. Results indicate no difference between the limbs for individuals, but differences in limb synergies at the population level. Left limb synergies were found to be more similar than right limb synergies across left- and right-handed individuals. Synergies of the left hand of left dominant individuals were found to have greater population level similarity than the other limbs tested. Results are interpreted with respect to known differences in the neuroanatomy and neurophysiology of proximal and distal upper limb motor control. Implications for skill training in sports requiring dexterous control of the hand are discussed.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.3390/s22145349
