Our brain perceives the world by exploiting multisensory cues to extract information about various aspects of external stimuli. The sensory cues from the same stimulus should be integrated to improve perception, and otherwise segregated to distinguish different stimuli. In reality, however, the brain faces the challenge of recognizing stimuli without knowing in advance the sources of sensory cues. To address this challenge, we propose that the brain conducts integration and segregation concurrently with complementary neurons. Studying the inference of heading-direction via visual and vestibular cues, we develop a network model with two reciprocally connected modules modeling interacting visual-vestibular areas. In each module, there are two groups of neurons whose tunings under each sensory cue are either congruent or opposite. We show that congruent neurons implement integration, while opposite neurons compute cue disparity information for segregation, and the interplay between two groups of neurons achieves efficient multisensory information processing.
more »
« less
A Normative Theory for Causal Inference and Bayes Factor Computation in Neural Circuits
This study provides a normative theory for how Bayesian causal inference can
be implemented in neural circuits. In both cognitive processes such as causal
reasoning and perceptual inference such as cue integration, the nervous systems
need to choose different models representing the underlying causal structures
when making inferences on external stimuli. In multisensory processing, for
example, the nervous system has to choose whether to integrate or segregate inputs
from different sensory modalities to infer the sensory stimuli, based on whether
the inputs are from the same or different sources. Making this choice is a model
selection problem requiring the computation of Bayes factor, the ratio of likelihoods
between the integration and the segregation models. In this paper, we consider
the causal inference in multisensory processing and propose a novel generative
model based on neural population code that takes into account both stimulus feature
and stimulus reliability in the inference. In the case of circular variables such as
heading direction, our normative theory yields an analytical solution for computing
the Bayes factor, with a clear geometric interpretation, which can be implemented
by simple additive mechanisms with neural population code. Numerical simulation
shows that the tunings of the neurons computing Bayes factor are consistent with
the "opposite neurons" discovered in dorsal medial superior temporal (MSTd) and
the ventral intraparietal (VIP) areas for visual-vestibular processing. This study
illuminates a potential neural mechanism for causal inference in the brain.
more »
« less
- Award ID(s):
- 1816568
- PAR ID:
- 10180781
- Date Published:
- Journal Name:
- Advances in neural information processing systems
- Volume:
- 32
- ISSN:
- 1049-5258
- Page Range / eLocation ID:
- 3804--3813
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
A worm called Caenorhabditis elegans has a nervous system made up of only 302 neurons, far fewer than the billions of cells that comprise our own brains. And yet these few hundred neurons are enough for these worms to detect and respond to their surroundings. C. elegans is thus a popular choice for studying how nervous systems process sensory information and use it to control behavior. Yet, most experiments to date have used only simple stimuli, such as taps or pokes, and studied a handful of behaviors, such as whether or not a worm stops moving or backs up. This limits the conclusions it has been possible to draw. Liu et al. therefore set out to determine how the worm’s nervous system responds to more complex stimuli. These included physical stimuli, such as taps on the side of the dish containing the worms, as well as simulated stimuli. To generate the latter, Liu et al. used a technique called optogenetics to directly activate the neurons in the worm’s body that would normally detect information from the senses, by simply shining a light on the worms. Doing so gives the worm the sensation of a physical stimulus, even though none was present. Liu et al. then used mathematics to examine the relationships between the stimuli and the worms’ responses. The results confirmed that worms usually respond to simple stimuli, such as taps on the side of their dish, by backing up. But they also revealed more advanced forms of stimulus processing. The worms responded differently to stimuli that increased over time versus decreased, for example. A worm's response to a stimulus also varied depending on what the worm was doing at the time. Worms that were in the middle of turns, for instance, ignored stimuli to which they would normally respond. This suggests that an animal’s current behavior influences how its nervous system interprets sensory information. The discovery of relatively sophisticated responses to sensory stimuli in C. elegans indicates that even simple nervous systems are capable of flexible sensory processing. This lays a foundation for understanding how neural circuits interpret sensory signals. Building on this work will ultimately help us understand how more complicated nervous systems interpret and respond to the world.more » « less
-
Many theories assume that a sensory neuron’s higher firing rate indicates a greater probability of its preferred stimulus. However, this contradicts 1) the adaptation phenomena where prolonged exposure to, and thus increased probability of, a stimulus reduces the firing rates of cells tuned to the stimulus; and 2) the observation that unexpected (low probability) stimuli capture attention and increase neuronal firing. Other theories posit that the brain builds predictive/efficient codes for reconstructing sensory inputs. However, they cannot explain that the brain preserves some information while discarding other. We propose that in sensory areas, projection neurons’ firing rates are proportional to optimal code length (i.e., negative log estimated probability), and their spike patterns are the code, for useful features in inputs. This hypothesis explains adaptation-induced changes of V1 orientation tuning curves, and bottom-up attention. We discuss how the modern minimum-description-length (MDL) principle may help understand neural codes. Because regularity extraction is relative to a model class (defined by cells) via its optimal universal code (OUC), MDL matches the brain’s purposeful, hierarchical processing without input reconstruction. Such processing enables input compression/understanding even when model classes do not contain true models. Top-down attention modifies lower-level OUCs via feedback connections to enhance transmission of behaviorally relevant information. Although OUCs concern lossless data compression, we suggest possible extensions to lossy, prefix-free neural codes for prompt, online processing of most important aspects of stimuli while minimizing behaviorally relevant distortion. Finally, we discuss how neural networks might learn MDL’s normalized maximum likelihood (NML) distributions from input data.more » « less
-
null (Ed.)Both experimenter-controlled stimuli and stimulus-independent variables impact cortical neural activity. A major hurdle to understanding neural representation is distinguishing between qualitatively different causes of the fluctuating population activity. We applied an unsupervised low-rank tensor decomposition analysis to the recorded population activity in the visual cortex of awake mice in response to repeated presentations of naturalistic visual stimuli. We found that neurons covaried largely independently of individual neuron stimulus response reliability and thus encoded both stimulus-driven and stimulus-independent variables. Importantly, a neuron’s response reliability and the neuronal coactivation patterns substantially reorganized for different external visual inputs. Analysis of recurrent balanced neural network models revealed that both the stimulus specificity and the mixed encoding of qualitatively different variables can arise from clustered external inputs. These results establish that coactive neurons with diverse response reliability mediate a mixed representation of stimulus-driven and stimulus-independent variables in the visual cortex. NEW & NOTEWORTHY V1 neurons covary largely independently of individual neuron’s response reliability. A single neuron’s response reliability imposes only a weak constraint on its encoding capabilities. Visual stimulus instructs a neuron’s reliability and coactivation pattern. Network models revealed using clustered external inputs.more » « less
-
more » « less
Abstract Multisensory integration (MSI) combines information from more than one sensory modality to elicit behaviours distinct from unisensory behaviours. MSI is best understood in animals with complex brains and specialized centres for parsing different modes of sensory information, but dispersive larvae of sessile marine invertebrates utilize multimodal environmental sensory stimuli to base irreversible settlement decisions on, and most lack complex brains. Here, we examined the sensory determinants of settlement in actinula larvae of the hydrozoan
Ectopleura crocea (Cnidaria), which possess a diffuse nerve net. A factorial settlement study revealed that photo‐, chemo‐ and mechanosensory cues each influenced the settlement response in a complex and hierarchical manner that was dependent on specific combinations of cues, an indication of MSI. Additionally, sensory gene expression over development peaked with developmental competence to settle, which in actinulae, requires cnidocyte discharge. Transcriptome analyses also highlighted several deep homological links between cnidarian and bilaterian mechano‐, chemo‐, and photosensory pathways. Fluorescent in situ hybridization studies of candidate transcripts suggested cellular partitioning of sensory function among the few cell types that comprise the actinula nervous system, where ubiquitous polymodal sensory neurons expressing putative chemo‐ and photosensitivity interface with mechanoreceptive cnidocytes. We propose a simple multisensory processing circuit, involving polymodal chemo/photosensory neurons and mechanoreceptive cnidocytes, that is sufficient to explain MSI in actinulae settlement. Our study demonstrates that MSI is not exclusive to complex brains, but likely predated and contextualized their evolution.
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
