An official website of the United States government
A key factor in the clinical translation of brain-machine interfaces (BMIs) for restoring hand motor function will be their robustness to changes in a task. With functional electrical stimulation (FES) for example, the patient’s own hand will be used to produce a wide range of forces in otherwise similar movements. To investigate the impact of task changes on BMI performance, we trained two rhesus macaques to control a virtual hand with their physical hand while we added springs to each finger group (index or middle-ring-small) or altered their wrist posture. Using simultaneously recorded intracortical neural activity, finger positions, and electromyography, we found that decoders trained in one context did not generalize well to other contexts, leading to significant increases in prediction error, especially for muscle activations. However, with respect to online BMI control of the virtual hand, changing either the decoder training task context or the hand’s physical context during online control had little effect on online performance. We explain this dichotomy by showing that the structure of neural population activity remained similar in new contexts, which could allow for fast adjustment online. Additionally, we found that neural activity shifted trajectories proportional to the required muscle activation in new contexts. This shift in neural activity possibly explains biases to off-context kinematic predictions and suggests a feature that could help predict different magnitude muscle activations while producing similar kinematics.
more »
« less
Restoring continuous finger function with temporarily paralyzed nonhuman primates using brain–machine interfaces
Abstract Objective. Brain–machine interfaces (BMIs) have shown promise in extracting upper extremity movement intention from the thoughts of nonhuman primates and people with tetraplegia. Attempts to restore a user’s own hand and arm function have employed functional electrical stimulation (FES), but most work has restored discrete grasps. Little is known about how well FES can control continuous finger movements. Here, we use a low-power brain-controlled functional electrical stimulation (BCFES) system to restore continuous volitional control of finger positions to a monkey with a temporarily paralyzed hand. Approach. We delivered a nerve block to the median, radial, and ulnar nerves just proximal to the elbow to simulate finger paralysis, then used a closed-loop BMI to predict finger movements the monkey was attempting to make in two tasks. The BCFES task was one-dimensional in which all fingers moved together, and we used the BMI’s predictions to control FES of the monkey’s finger muscles. The virtual two-finger task was two-dimensional in which the index finger moved simultaneously and independently from the middle, ring, and small fingers, and we used the BMI’s predictions to control movements of virtual fingers, with no FES. Main results. In the BCFES task, the monkey improved his success rate to 83% (1.5 s median acquisition time) when using the BCFES system during temporary paralysis from 8.8% (9.5 s median acquisition time, equal to the trial timeout) when attempting to use his temporarily paralyzed hand. In one monkey performing the virtual two-finger task with no FES, we found BMI performance (task success rate and completion time) could be completely recovered following temporary paralysis by executing recalibrated feedback-intention training one time. Significance. These results suggest that BCFES can restore continuous finger function during temporary paralysis using existing low-power technologies and brain-control may not be the limiting factor in a BCFES neuroprosthesis.
more »
« less
- Award ID(s):
- 1926576
- PAR ID:
- 10450463
- Date Published:
- Journal Name:
- Journal of Neural Engineering
- Volume:
- 20
- Issue:
- 3
- ISSN:
- 1741-2560
- Page Range / eLocation ID:
- 036006
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Despite the rapid progress and interest in brain-machine interfaces that restore motor function, the performance of prosthetic fingers and limbs has yet to mimic native function. The algorithm that converts brain signals to a control signal for the prosthetic device is one of the limitations in achieving rapid and realistic finger movements. To achieve more realistic finger movements, we developed a shallow feed-forward neural network to decode real-time two-degree-of-freedom finger movements in two adult male rhesus macaques. Using a two-step training method, a recalibrated feedback intention–trained (ReFIT) neural network is introduced to further improve performance. In 7 days of testing across two animals, neural network decoders, with higher-velocity and more natural appearing finger movements, achieved a 36% increase in throughput over the ReFIT Kalman filter, which represents the current standard. The neural network decoders introduced herein demonstrate real-time decoding of continuous movements at a level superior to the current state-of-the-art and could provide a starting point to using neural networks for the development of more naturalistic brain-controlled prostheses.more » « less
-
null (Ed.)Objective: Functional electrical stimulation (FES) is a common technique to elicit muscle contraction and help improve muscle strength. Traditional FES over the muscle belly typically only activates superficial muscle regions. In the case of hand FES, this prevents the activation of the deeper flexor muscles which control the distal finger joints. Here, we evaluated whether an alternative transcutaneous nerve-bundle stimulation approach can activate both superficial and deep extrinsic finger flexors using a high-density stimulation grid. Methods: Transverse ultrasound of the forearm muscles was used to obtain cross-sectional images of the underlying finger flexors during stimulated finger flexions and kinematically-matched voluntary motions. Finger kinematics were recorded, and an image registration method was used to capture the large deformation of the muscle regions during each flexion. This deformation was used as a surrogate measure of the contraction of muscle tissue, and the regions of expanding tissue can identify activated muscles. Results: The nerve-bundle stimulation elicited contractions in the superficial and deep finger flexors. Both separate and concurrent activation of these two muscles were observed. Joint kinematics of the fingers also matched the expected regions of muscle contractions. Conclusions: Our results showed that the nerve-bundle stimulation technique can activate the deep extrinsic finger flexors, which are typically not accessible via traditional surface FES. Significance: Our nerve-bundle stimulation method enables us to produce the full range of motion of different joints necessary for various functional grasps, which could benefit future neuroprosthetic applications.more » « less
-
Abstract Objective.While brain–machine interfaces (BMIs) are promising technologies that could provide direct pathways for controlling the external world and thus regaining motor capabilities, their effectiveness is hampered by decoding errors. Previous research has demonstrated the detection and correction of BMI outcome errors, which occur at the end of trials. Here we focus on continuous detection and correction of BMI execution errors, which occur during real-time movements.Approach.Two adult male rhesus macaques were implanted with Utah arrays in the motor cortex. The monkeys performed single or two-finger group BMI tasks where a Kalman filter decoded binned spiking-band power into intended finger kinematics. Neural activity was analyzed to determine how it depends not only on the kinematics of the fingers, but also on the distance of each finger-group to its target. We developed a method to detect erroneous movements, i.e. consistent movements away from the target, from the same neural activity used by the Kalman filter. Detected errors were corrected by a simple stopping strategy, and the effect on performance was evaluated.Mainresults.First we show that including distance to target explains significantly more variance of the recorded neural activity. Then, for the first time, we demonstrate that neural activity in motor cortex can be used to detect execution errors during BMI controlled movements. Keeping false positive rate below , it was possible to achieve mean true positive rate of online. Despite requiring 200 ms to detect and react to suspected errors, we were able to achieve a significant improvement in task performance via reduced orbiting time of one finger group.Significance.Neural activity recorded in motor cortex for BMI control can be used to detect and correct BMI errors and thus to improve performance. Further improvements may be obtained by enhancing classification and correction strategies.more » « less
-
Individuals with paralyzed limbs due to spinal cord injuries lack the ability to perform the reaching motions necessary to every day life. Functional electrical stimulation (FES) is a promising technology for restoring reaching movements to these individuals by reanimating their paralyzed muscles. We have proposed using a quasi-static model-based control strategy to achieve reaching controlled by FES. This method uses a series of static positions to connect the starting wrist position to the goal. As a first step to implementing this controller, we have completed a simulated study using a MATLAB based dynamic model of the arm in order to determine the suitable parameters for the quasi-static controller. The selected distance between static positions in the path was 6 cm, and the amount of time between switching target positions was 1.3 s. The final controller can complete reaches of over 30 cm with a median accuracy of 6.8 cm.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1088/1741-2552/accf36
