An official website of the United States government
Traditional models of motor control typically operate in the domain of continuous signals such as spike rates, forces, and kinematics. However, there is growing evidence that precise spike timings encode significant information that coordinates and causally influences motor control. Some existing neural network models incorporate spike timing precision but they neither predict motor spikes coordinated across multiple motor units nor capture sensory-driven modulation of agile locomotor control. In this paper, we propose a visual encoder and model of a sensorimotor system based on a recurrent neural network (RNN) that utilizes spike timing encoding during smooth pursuit target tracking. We use this to predict a nearly complete, spike-resolved motor program of a hawkmoth that requires coordinated millisecond precision across 10 major flight motor units. Each motor unit enervates one muscle and utilizes both rate and timing encoding. Our model includes a motion detection mechanism inspired by the hawkmoth's compound eye, a convolutional encoder that compresses the sensory input, and a simple RNN that is sufficient to sequentially predict wingstroke-to-wingstroke modulation in millisecond-precise spike timings. The two-layer output architecture of the RNN separately predicts the occurrence and timing of each spike in the motor program. The dataset includes spikes recorded from all motor units during a tethered flight where the hawkmoth attends to a moving robotic flower, with a total of roughly 7000 wingstrokes from 16 trials on 5 hawkmoth subjects. Intra-trial and same-subject inter-trial predictions on the test data show that nearly every spike can be predicted within 2 ms of its known spike timing precision values. Whereas, spike occurrence prediction accuracy is about 90%. Overall, our model can predict the precise spike timing of a nearly complete motor program for hawkmoth flight with a precision comparable to that seen in agile flying insects. Such an encoding framework that captures visually-modulated precise spike timing codes and coordination can reveal how organisms process visual cues for agile movements. It can also drive the next generation of neuromorphic controllers for navigation in complex environments.
more »
« less
Precise timing is ubiquitous, consistent, and coordinated across a comprehensive, spike-resolved flight motor program
Sequences of action potentials, or spikes, carry information in the number of spikes and their timing. Spike timing codes are critical in many sensory systems, but there is now growing evidence that millisecond-scale changes in timing also carry information in motor brain regions, descending decision-making circuits, and individual motor units. Across all of the many signals that control a behavior, how ubiquitous, consistent, and coordinated are spike timing codes? Assessing these open questions ideally involves recording across the whole motor program with spike-level resolution. To do this, we took advantage of the relatively few motor units controlling the wings of a hawk moth, Manduca sexta . We simultaneously recorded nearly every action potential from all major wing muscles and the resulting forces in tethered flight. We found that timing encodes more information about turning behavior than spike count in every motor unit, even though there is sufficient variation in count alone. Flight muscles vary broadly in function as well as in the number and timing of spikes. Nonetheless, each muscle with multiple spikes consistently blends spike timing and count information in a 3:1 ratio. Coding strategies are consistent. Finally, we assess the coordination of muscles using pairwise redundancy measured through interaction information. Surprisingly, not only are all muscle pairs coordinated, but all coordination is accomplished almost exclusively through spike timing, not spike count. Spike timing codes are ubiquitous, consistent, and essential for coordination.
more »
« less
- Award ID(s):
- 1806833
- PAR ID:
- 10174653
- Date Published:
- Journal Name:
- Proceedings of the National Academy of Sciences
- Volume:
- 116
- Issue:
- 52
- ISSN:
- 0027-8424
- Page Range / eLocation ID:
- 26951 to 26960
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Latham, Peter E. (Ed.)Sensory inputs in nervous systems are often encoded at the millisecond scale in a precise spike timing code. There is now growing evidence in behaviors ranging from slow breathing to rapid flight for the prevalence of precise timing encoding in motor systems. Despite this, we largely do not know at what scale timing matters in these circuits due to the difficulty of recording a complete set of spike-resolved motor signals and assessing spike timing precision for encoding continuous motor signals. We also do not know if the precision scale varies depending on the functional role of different motor units. We introduce a method to estimate spike timing precision in motor circuits using continuous MI estimation at increasing levels of added uniform noise. This method can assess spike timing precision at fine scales for encoding rich motor output variation. We demonstrate the advantages of this approach compared to a previously established discrete information theoretic method of assessing spike timing precision. We use this method to analyze the precision in a nearly complete, spike resolved recording of the 10 primary wing muscles control flight in an agile hawk moth, Manduca sexta . Tethered moths visually tracked a robotic flower producing a range of turning (yaw) torques. We know that all 10 muscles in this motor program encode the majority of information about yaw torque in spike timings, but we do not know whether individual muscles encode motor information at different levels of precision. We demonstrate that the scale of temporal precision in all motor units in this insect flight circuit is at the sub-millisecond or millisecond-scale, with variation in precision scale present between muscle types. This method can be applied broadly to estimate spike timing precision in sensory and motor circuits in both invertebrates and vertebrates.more » « less
-
ABSTRACT Flying insects solve a daunting control problem of generating a patterned and precise motor program to stay airborne and generate agile maneuvers. In this motor program, each muscle encodes information about movement in precise spike timing down to the millisecond scale. Whereas individual muscles share information about movement, we do not know whether they have separable effects on an animal's motion, or whether muscles functionally interact such that the effects of any muscle's timing depend heavily on the state of the entire musculature. To answer these questions, we performed spike-resolution electromyography and electrical stimulation in the hawkmoth Manduca sexta during tethered flapping. We specifically explored how flight power muscles contribute to pitch control. Combining correlational study of visually induced turns with causal manipulation of spike timing, we discovered likely coordination patterns for pitch turns, and investigated whether these patterns can drive pitch control. We observed significant timing change of the main downstroke muscles, the dorsolongitudinal muscles (DLMs), associated with pitch turns. Causally inducing this timing change in the DLMs with electrical stimulation produced a consistent, mechanically relevant feature in pitch torque, establishing that power muscles in M. sexta have a control role in pitch. Because changes were evoked in only the DLMs, however, these pitch torque features left large unexplained variation. We found this unexplained variation indicates significant functional overlap in pitch control such that precise timing of one power muscle does not produce a precise turn, demonstrating the importance of coordination across the entire motor program for flight.more » « less
-
null (Ed.)Practice of a complex motor gesture involves motor exploration to attain a better match to target, but little is known about the neural code for such exploration. We examine spiking in a premotor area of the songbird brain critical for song modification and quantify correlations between spiking and time in the motor sequence. While isolated spikes code for time in song during performance of song to a female bird, extended strings of spiking and silence, particularly bursts, code for time in song during undirected (solo) singing, or “practice.” Bursts code for particular times in song with more information than individual spikes, and this spike-spike synergy is significantly higher during undirected singing. The observed pattern information cannot be accounted for by a Poisson model with a matched time-varying rate, indicating that the precise timing of spikes in both bursts in undirected singing and isolated spikes in directed singing code for song with a temporal code. Temporal coding during practice supports the hypothesis that lateral magnocellular nucleus of the anterior nidopallium neurons actively guide song modification at local instances in time. NEW & NOTEWORTHY This paper shows that bursts of spikes in the songbird brain during practice carry information about the output motor pattern. The brain’s code for song changes with social context, in performance versus practice. Synergistic combinations of spiking and silence code for time in the bird’s song. This is one of the first uses of information theory to quantify neural information about a motor output. This activity may guide changes to the song.more » « less
-
Abstract BackgroundMuscle synergies, computationally identified intermuscular coordination patterns, have been utilized to characterize neuromuscular control and learning in humans. However, it is unclear whether it is possible to alter the existing muscle synergies or develop new ones in an intended way through a relatively short-term motor exercise in adulthood. This study aimed to test the feasibility of expanding the repertoire of intermuscular coordination patterns through an isometric, electromyographic (EMG) signal-guided exercise in the upper extremity (UE) of neurologically intact individuals. Methods10 participants were trained for six weeks to induce independent control of activating a pair of elbow flexor muscles that tended to be naturally co-activated in force generation. An untrained isometric force generation task was performed to assess the effect of the training on the intermuscular coordination of the trained UE. We applied a non-negative matrix factorization on the EMG signals recorded from 12 major UE muscles during the assessment to identify the muscle synergies. In addition, the performance of training tasks and the characteristics of individual muscles’ activity in both time and frequency domains were quantified as the training outcomes. ResultsTypically, in two weeks of the training, participants could use newly developed muscle synergies when requested to perform new, untrained motor tasks by activating their UE muscles in the trained way. Meanwhile, their habitually expressed muscle synergies, the synergistic muscle activation groups that were used before the training, were conserved throughout the entire training period. The number of muscle synergies activated for the task performance remained the same. As the new muscle synergies were developed, the neuromotor control of the trained muscles reflected in the metrics, such as the ratio between the targeted muscles, number of matched targets, and task completion time, was improved. ConclusionThese findings suggest that our protocol can increase the repertoire of readily available muscle synergies and improve motor control by developing the activation of new muscle coordination patterns in healthy adults within a relatively short period. Furthermore, the study shows the potential of the isometric EMG-guided protocol as a neurorehabilitation tool for aiming motor deficits induced by abnormal intermuscular coordination after neurological disorders. Trial registrationThis study was registered at the Clinical Research Information Service (CRiS) of the Korea National Institute of Health (KCT0005803) on 1/22/2021.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1073/PNAS.1907513116
