An official website of the United States government
Traditional models of motor control typically operate in the domain of continuous signals such as spike rates, forces, and kinematics. However, there is growing evidence that precise spike timings encode significant information that coordinates and causally influences motor control. Some existing neural network models incorporate spike timing precision but they neither predict motor spikes coordinated across multiple motor units nor capture sensory-driven modulation of agile locomotor control. In this paper, we propose a visual encoder and model of a sensorimotor system based on a recurrent neural network (RNN) that utilizes spike timing encoding during smooth pursuit target tracking. We use this to predict a nearly complete, spike-resolved motor program of a hawkmoth that requires coordinated millisecond precision across 10 major flight motor units. Each motor unit enervates one muscle and utilizes both rate and timing encoding. Our model includes a motion detection mechanism inspired by the hawkmoth's compound eye, a convolutional encoder that compresses the sensory input, and a simple RNN that is sufficient to sequentially predict wingstroke-to-wingstroke modulation in millisecond-precise spike timings. The two-layer output architecture of the RNN separately predicts the occurrence and timing of each spike in the motor program. The dataset includes spikes recorded from all motor units during a tethered flight where the hawkmoth attends to a moving robotic flower, with a total of roughly 7000 wingstrokes from 16 trials on 5 hawkmoth subjects. Intra-trial and same-subject inter-trial predictions on the test data show that nearly every spike can be predicted within 2 ms of its known spike timing precision values. Whereas, spike occurrence prediction accuracy is about 90%. Overall, our model can predict the precise spike timing of a nearly complete motor program for hawkmoth flight with a precision comparable to that seen in agile flying insects. Such an encoding framework that captures visually-modulated precise spike timing codes and coordination can reveal how organisms process visual cues for agile movements. It can also drive the next generation of neuromorphic controllers for navigation in complex environments.
more »
« less
Maximally efficient prediction in the early fly visual system may support evasive flight maneuvers
The visual system must make predictions to compensate for inherent delays in its processing. Yet little is known, mechanistically, about how prediction aids natural behaviors. Here, we show that despite a 20-30ms intrinsic processing delay, the vertical motion sensitive (VS) network of the blowfly achieves maximally efficient prediction. This prediction enables the fly to fine-tune its complex, yet brief, evasive flight maneuvers according to its initial ego-rotation at the time of detection of the visual threat. Combining a rich database of behavioral recordings with detailed compartmental modeling of the VS network, we further show that the VS network has axonal gap junctions that are critical for optimal prediction. During evasive maneuvers, a VS subpopulation that directly innervates the neck motor center can convey predictive information about the fly’s future ego-rotation, potentially crucial for ongoing flight control. These results suggest a novel sensory-motor pathway that links sensory prediction to behavior.
more »
« less
- PAR ID:
- 10249114
- Editor(s):
- Graham, Lyle J.
- Date Published:
- Journal Name:
- PLOS Computational Biology
- Volume:
- 17
- Issue:
- 5
- ISSN:
- 1553-7358
- Page Range / eLocation ID:
- e1008965
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Natural behaviors are a coordinated symphony of motor acts that drive reafferent (self-induced) sensory activation. Individual sensors cannot disambiguate exafferent (externally induced) from reafferent sources. Nevertheless, animals readily differentiate between these sources of sensory signals to carry out adaptive behaviors through corollary discharge circuits (CDCs), which provide predictive motor signals from motor pathways to sensory processing and other motor pathways. Yet, how CDCs comprehensively integrate into the nervous system remains unexplored. Here, we use connectomics, neuroanatomical, physiological, and behavioral approaches to resolve the network architecture of two pairs of ascending histaminergic neurons (AHNs) in Drosophila, which function as a predictive CDC in other insects. Both AHN pairs receive input primarily from a partially overlapping population of descending neurons, especially from DNg02, which controls wing motor output. Using Ca2+ imaging and behavioral recordings, we show that AHN activation is correlated to flight behavior and precedes wing motion. Optogenetic activation of DNg02 is sufficient to activate AHNs, indicating that AHNs are activated by descending commands in advance of behavior and not as a consequence of sensory input. Downstream, each AHN pair targets predominantly non-overlapping networks, including those that process visual, auditory, and mechanosensory information, as well as networks controlling wing, haltere, and leg sensorimotor control. These results support the conclusion that the AHNs provide a predictive motor signal about wing motor state to mostly non-overlapping sensory and motor networks. Future work will determine how AHN signaling is driven by other descending neurons and interpreted by AHN downstream targets to maintain adaptive sensorimotor performance.more » « less
-
Abstract The sensory neocortex consists of hierarchically-organized areas reciprocally connected via feedforward and feedback circuits. Feedforward connections shape the receptive field properties of neurons in higher areas within parallel streams specialized in processing specific stimulus attributes. Feedback connections have been implicated in top-down modulations, such as attention, prediction and sensory context. However, their computational role remains unknown, partly because we lack knowledge about rules of feedback connectivity to constrain models of feedback function. For example, it is unknown whether feedback connections maintain stream-specific segregation, or integrate information across parallel streams. Using viral-mediated labeling of feedback connections arising from specific cytochrome-oxidase stripes of macaque visual area V2, here we show that feedback to the primary visual cortex (V1) is organized into parallel streams resembling the reciprocal feedforward pathways. This suggests that functionally-specialized V2 feedback channels modulate V1 responses to specific stimulus attributes, an organizational principle potentially extending to feedback pathways in other sensory systems.more » « less
-
Latham, Peter E. (Ed.)Sensory inputs in nervous systems are often encoded at the millisecond scale in a precise spike timing code. There is now growing evidence in behaviors ranging from slow breathing to rapid flight for the prevalence of precise timing encoding in motor systems. Despite this, we largely do not know at what scale timing matters in these circuits due to the difficulty of recording a complete set of spike-resolved motor signals and assessing spike timing precision for encoding continuous motor signals. We also do not know if the precision scale varies depending on the functional role of different motor units. We introduce a method to estimate spike timing precision in motor circuits using continuous MI estimation at increasing levels of added uniform noise. This method can assess spike timing precision at fine scales for encoding rich motor output variation. We demonstrate the advantages of this approach compared to a previously established discrete information theoretic method of assessing spike timing precision. We use this method to analyze the precision in a nearly complete, spike resolved recording of the 10 primary wing muscles control flight in an agile hawk moth, Manduca sexta . Tethered moths visually tracked a robotic flower producing a range of turning (yaw) torques. We know that all 10 muscles in this motor program encode the majority of information about yaw torque in spike timings, but we do not know whether individual muscles encode motor information at different levels of precision. We demonstrate that the scale of temporal precision in all motor units in this insect flight circuit is at the sub-millisecond or millisecond-scale, with variation in precision scale present between muscle types. This method can be applied broadly to estimate spike timing precision in sensory and motor circuits in both invertebrates and vertebrates.more » « less
-
Our brain perceives the world by exploiting multisensory cues to extract information about various aspects of external stimuli. The sensory cues from the same stimulus should be integrated to improve perception, and otherwise segregated to distinguish different stimuli. In reality, however, the brain faces the challenge of recognizing stimuli without knowing in advance the sources of sensory cues. To address this challenge, we propose that the brain conducts integration and segregation concurrently with complementary neurons. Studying the inference of heading-direction via visual and vestibular cues, we develop a network model with two reciprocally connected modules modeling interacting visual-vestibular areas. In each module, there are two groups of neurons whose tunings under each sensory cue are either congruent or opposite. We show that congruent neurons implement integration, while opposite neurons compute cue disparity information for segregation, and the interplay between two groups of neurons achieves efficient multisensory information processing.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1371/journal.pcbi.1008965
