skip to main content


Title: Multimodal Integration Across Spatiotemporal Scales to Guide Invertebrate Locomotion
Synopsis Locomotion is a hallmark of organisms which has enabled adaptive radiation to an extraordinarily diverse class of ecological niches, and allows animals to move across vast distances. Sampling from multiple sensory modalities enables animals to acquire rich information to guide locomotion. Locomotion without sensory feedback is haphazard; therefore, sensory and motor systems have evolved complex interactions to generate adaptive behavior. Notably, sensory-guided locomotion acts over broad spatial and temporal scales to permit goal-seeking behavior, whether to localize food by tracking an attractive odor plume or to search for a potential mate. How does the brain integrate multimodal stimuli over different temporal and spatial scales to effectively control behavior? In this review, we classify locomotion into three ordinally ranked hierarchical layers that act over distinct spatiotemporal scales: stabilization, motor primitives, and higher-order tasks, respectively. We discuss how these layers present unique challenges and opportunities for sensorimotor integration. We focus on recent advances in invertebrate locomotion due to their accessible neural and mechanical signals from the whole brain, limbs, and sensors. Throughout, we emphasize neural-level description of computations for multimodal integration in genetic model systems, including the fruit fly, Drosophila melanogaster, and the yellow fever mosquito, Aedes aegypti. We identify that summation (e.g., gating) and weighting—which are inherent computations of spiking neurons—underlie multimodal integration across spatial and temporal scales, therefore suggesting collective strategies to guide locomotion.  more » « less
Award ID(s):
2010768
NSF-PAR ID:
10310731
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Integrative and Comparative Biology
Volume:
61
Issue:
3
ISSN:
1540-7063
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. INTRODUCTION A brainwide, synaptic-resolution connectivity map—a connectome—is essential for understanding how the brain generates behavior. However because of technological constraints imaging entire brains with electron microscopy (EM) and reconstructing circuits from such datasets has been challenging. To date, complete connectomes have been mapped for only three organisms, each with several hundred brain neurons: the nematode C. elegans , the larva of the sea squirt Ciona intestinalis , and of the marine annelid Platynereis dumerilii . Synapse-resolution circuit diagrams of larger brains, such as insects, fish, and mammals, have been approached by considering select subregions in isolation. However, neural computations span spatially dispersed but interconnected brain regions, and understanding any one computation requires the complete brain connectome with all its inputs and outputs. RATIONALE We therefore generated a connectome of an entire brain of a small insect, the larva of the fruit fly, Drosophila melanogaster. This animal displays a rich behavioral repertoire, including learning, value computation, and action selection, and shares homologous brain structures with adult Drosophila and larger insects. Powerful genetic tools are available for selective manipulation or recording of individual neuron types. In this tractable model system, hypotheses about the functional roles of specific neurons and circuit motifs revealed by the connectome can therefore be readily tested. RESULTS The complete synaptic-resolution connectome of the Drosophila larval brain comprises 3016 neurons and 548,000 synapses. We performed a detailed analysis of the brain circuit architecture, including connection and neuron types, network hubs, and circuit motifs. Most of the brain’s in-out hubs (73%) were postsynaptic to the learning center or presynaptic to the dopaminergic neurons that drive learning. We used graph spectral embedding to hierarchically cluster neurons based on synaptic connectivity into 93 neuron types, which were internally consistent based on other features, such as morphology and function. We developed an algorithm to track brainwide signal propagation across polysynaptic pathways and analyzed feedforward (from sensory to output) and feedback pathways, multisensory integration, and cross-hemisphere interactions. We found extensive multisensory integration throughout the brain and multiple interconnected pathways of varying depths from sensory neurons to output neurons forming a distributed processing network. The brain had a highly recurrent architecture, with 41% of neurons receiving long-range recurrent input. However, recurrence was not evenly distributed and was especially high in areas implicated in learning and action selection. Dopaminergic neurons that drive learning are amongst the most recurrent neurons in the brain. Many contralateral neurons, which projected across brain hemispheres, were in-out hubs and synapsed onto each other, facilitating extensive interhemispheric communication. We also analyzed interactions between the brain and nerve cord. We found that descending neurons targeted a small fraction of premotor elements that could play important roles in switching between locomotor states. A subset of descending neurons targeted low-order post-sensory interneurons likely modulating sensory processing. CONCLUSION The complete brain connectome of the Drosophila larva will be a lasting reference study, providing a basis for a multitude of theoretical and experimental studies of brain function. The approach and computational tools generated in this study will facilitate the analysis of future connectomes. Although the details of brain organization differ across the animal kingdom, many circuit architectures are conserved. As more brain connectomes of other organisms are mapped in the future, comparisons between them will reveal both common and therefore potentially optimal circuit architectures, as well as the idiosyncratic ones that underlie behavioral differences between organisms. Some of the architectural features observed in the Drosophila larval brain, including multilayer shortcuts and prominent nested recurrent loops, are found in state-of-the-art artificial neural networks, where they can compensate for a lack of network depth and support arbitrary, task-dependent computations. Such features could therefore increase the brain’s computational capacity, overcoming physiological constraints on the number of neurons. Future analysis of similarities and differences between brains and artificial neural networks may help in understanding brain computational principles and perhaps inspire new machine learning architectures. The connectome of the Drosophila larval brain. The morphologies of all brain neurons, reconstructed from a synapse-resolution EM volume, and the synaptic connectivity matrix of an entire brain. This connectivity information was used to hierarchically cluster all brains into 93 cell types, which were internally consistent based on morphology and known function. 
    more » « less
  2. Synopsis Goal-directed learning is a key contributor to evolutionary fitness in animals. The neural mechanisms that mediate learning often involve the neuromodulator dopamine. In higher order cortical regions, most of what is known about dopamine’s role is derived from brain regions involved in motivation and decision-making, while significantly less is known about dopamine’s potential role in motor and/or sensory brain regions to guide performance. Research on rodents and primates represents over 95% of publications in the field, while little beyond basic anatomy is known in other vertebrate groups. This significantly limits our general understanding of how dopamine signaling systems have evolved as organisms adapt to their environments. This review takes a pan-vertebrate view of the literature on the role of dopamine in motor/sensory cortical regions, highlighting, when available, research on non-mammalian vertebrates. We provide a broad perspective on dopamine function and emphasize that dopamine-induced plasticity mechanisms are widespread across all cortical systems and associated with motor and sensory adaptations. The available evidence illustrates that there is a strong anatomical basis—dopamine fibers and receptor distributions—to hypothesize that pallial dopamine effects are widespread among vertebrates. Continued research progress in non-mammalian species will be crucial to further our understanding of how the dopamine system evolved to shape the diverse array of brain structures and behaviors among the vertebrate lineage. 
    more » « less
  3. Abstract

    Animals are often confronted with potentially informative stimuli from a variety of sensory modalities. Although there is a large proximate literature demonstrating multisensory integration, no general framework explains why animals integrate. We developed and tested a quantitative model that explains why multisensory integration is not always adaptive and explains why unimodal decision-making might be favored over multisensory integration. We present our model in terms of a prey that must determine the presence or absence of a predator. A greater chance of encountering a predator, a greater benefit of correctly responding to a predator, a lower benefit of correctly foraging, or a greater uncertainty of the second stimulus favors integration. Uncertainty of the first stimulus may either increase or decrease the favorability of integration. In three field studies, we demonstrate how our model can be empirically tested. We evaluated the model with field studies of yellow-bellied marmots (Marmota flaviventer) by presenting marmots with an olfactory-acoustic predator stimulus at a feed station. We found some support for the model's prediction that integration is favored when the second stimulus is less noisy. We hope additional predictions of the model will guide future empirical work that seeks to understand the extent to which multimodal integration might be situation dependent. We suggest that the model is generalizable beyond antipredator contexts and can be applied within or between individuals, populations, or species.

    Multisensory integration is often studied from a very proximate view that simply describes the process of integration. We developed a model, the first of its kind, to investigate the situations under which multisensory integration is adaptive. We empirically evaluated the model by investigating the conditions under which yellow-bellied marmots integrated predatory scents and sounds. We found that integration can depend on an animal's situation at a given point in time.

     
    more » « less
  4. null (Ed.)
    Synopsis Internal state profoundly alters perception and behavior. For example, a starved fly may approach and consume foods that it would otherwise find undesirable. A socially engaged newt may remain engaged in the presence of a predator, whereas a solitary newt would otherwise attempt to escape. Yet, the definition of internal state is fluid and ill-defined. As an interdisciplinary group of scholars spanning five career stages (from undergraduate to full professor) and six academic institutions, we came together in an attempt to provide an operational definition of internal state that could be useful in understanding the behavior and the function of nervous systems, at timescales relevant to the individual. In this perspective, we propose to define internal state through an integrative framework centered on dynamic and interconnected communication loops within and between the body and the brain. This framework is informed by a synthesis of historical and contemporary paradigms used by neurobiologists, ethologists, physiologists, and endocrinologists. We view internal state as composed of both spatially distributed networks (body–brain communication loops), and temporally distributed mechanisms that weave together neural circuits, physiology, and behavior. Given the wide spatial and temporal scales at which internal state operates—and therefore the broad range of scales at which it could be defined—we choose to anchor our definition in the body. Here we focus on studies that highlight body-to-brain signaling; body represented in endocrine signaling, and brain represented in sensory signaling. This integrative framework of internal state potentially unites the disparate paradigms often used by scientists grappling with body–brain interactions. We invite others to join us as we examine approaches and question assumptions to study the underlying mechanisms and temporal dynamics of internal state. 
    more » « less
  5. Understanding the intrinsic patterns of human brain is important to make inferences about the mind and brain-behavior association. Electrophysiological methods (i.e. MEG/EEG) provide direct measures of neural activity without the effect of vascular confounds. The blood oxygenated level-dependent (BOLD) signal of functional MRI (fMRI) reveals the spatial and temporal brain activity across different brain regions. However, it is unclear how to associate the high temporal resolution Electrophysiological measures with high spatial resolution fMRI signals. Here, we present a novel interpretable model for coupling the structure and function activity of brain based on heterogeneous contrastive graph representation. The proposed method is able to link manifest variables of the brain (i.e. MEG, MRI, fMRI and behavior performance) and quantify the intrinsic coupling strength of different modal signals. The proposed method learns the heterogeneous node and graph representations by contrasting the structural and temporal views through the mind to multimodal brain data. The first experiment with 1200 subjects from Human connectome Project (HCP) shows that the proposed method outperforms the existing approaches in predicting individual gender and enabling the location of the importance of brain regions with sex difference. The second experiment associates the structure and temporal views between the low-level sensory regions and high-level cognitive ones. The experimental results demonstrate that the dependence of structural and temporal views varied spatially through different modal variants. The proposed method enables the heterogeneous biomarkers explanation for different brain measurements. 
    more » « less