skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Striatal hub of dynamic and stabilized prediction coding in forebrain networks for olfactory reinforcement learning
Abstract Identifying the circuits responsible for cognition and understanding their embedded computations is a challenge for neuroscience. We establish here a hierarchical cross-scale approach, from behavioral modeling and fMRI in task-performing mice to cellular recordings, in order to disentangle local network contributions to olfactory reinforcement learning. At mesoscale, fMRI identifies a functional olfactory-striatal network interacting dynamically with higher-order cortices. While primary olfactory cortices respectively contribute only some value components, the downstream olfactory tubercle of the ventral striatum expresses comprehensively reward prediction, its dynamic updating, and prediction error components. In the tubercle, recordings reveal two underlying neuronal populations with non-redundant reward prediction coding schemes. One population collectively produces stabilized predictions as distributed activity across neurons; in the other, neurons encode value individually and dynamically integrate the recent history of uncertain outcomes. These findings validate a cross-scale approach to mechanistic investigations of higher cognitive functions in rodents.  more » « less
Award ID(s):
1724221
PAR ID:
10377904
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Nature Communications
Volume:
13
Issue:
1
ISSN:
2041-1723
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; ; ; (, Nature Communications)
    Abstract The learning of stimulus-outcome associations allows for predictions about the environment. Ventral striatum and dopaminergic midbrain neurons form a larger network for generating reward prediction signals from sensory cues. Yet, the network plasticity mechanisms to generate predictive signals in these distributed circuits have not been entirely clarified. Also, direct evidence of the underlying interregional assembly formation and information transfer is still missing. Here we show that phasic dopamine is sufficient to reinforce the distinctness of stimulus representations in the ventral striatum even in the absence of reward. Upon such reinforcement, striatal stimulus encoding gives rise to interregional assemblies that drive dopaminergic neurons during stimulus-outcome learning. These assemblies dynamically encode the predicted reward value of conditioned stimuli. Together, our data reveal that ventral striatal and midbrain reward networks form a reinforcing loop to generate reward prediction coding. 
    more » « less
  2. ; ; ; ; ; (, Journal of Neurophysiology)
    null (Ed.)
    Neural codes for sensory inputs have been hypothesized to reside in a broader space defined by ongoing patterns of spontaneous activity. To understand the structure of this spontaneous activity in the olfactory system, we performed high-density recordings of neural populations in the main olfactory bulb of awake mice. We observed changes in pairwise correlations of spontaneous activity between mitral and tufted (M/T) cells when animals were running, which resulted in an increase in the entropy of the population. Surprisingly, pairwise maximum entropy models that described the population activity using only assumptions about the firing rates and correlations of neurons were better at predicting the global structure of activity when animals were stationary as compared to when they were running, implying that higher order (3rd, 4th order) interactions governed population activity during locomotion. Taken together, we found that locomotion alters the functional interactions that shape spontaneous population activity at the earliest stages of olfactory processing, one synapse away from the sensory receptors in the nasal epithelium. These data suggest that the coding space available for sensory representations responds adaptively to the animal’s behavioral state. NEW & NOTEWORTHY The organization and structure of spontaneous population activity in the olfactory system places constraints of how odor information is represented. Using high-density electrophysiological recordings of mitral and tufted cells, we found that running increases the dimensionality of spontaneous activity, implicating higher order interactions among neurons during locomotion. Behavior, thus, flexibly alters neuronal activity at the earliest stages of sensory processing. 
    more » « less
  3. ; (, PLOS Computational Biology)
    Morrison, Abigail (Ed.)
    The Drosophila mushroom body exhibits dopamine dependent synaptic plasticity that underlies the acquisition of associative memories. Recordings of dopamine neurons in this system have identified signals related to external reinforcement such as reward and punishment. However, other factors including locomotion, novelty, reward expectation, and internal state have also recently been shown to modulate dopamine neurons. This heterogeneity is at odds with typical modeling approaches in which these neurons are assumed to encode a global, scalar error signal. How is dopamine dependent plasticity coordinated in the presence of such heterogeneity? We develop a modeling approach that infers a pattern of dopamine activity sufficient to solve defined behavioral tasks, given architectural constraints informed by knowledge of mushroom body circuitry. Model dopamine neurons exhibit diverse tuning to task parameters while nonetheless producing coherent learned behaviors. Notably, reward prediction error emerges as a mode of population activity distributed across these neurons. Our results provide a mechanistic framework that accounts for the heterogeneity of dopamine activity during learning and behavior. 
    more » « less
  4. ; ; ; ; ; ; ; ; ; ; et al (, bioRxiv)
    Abstract High-resolution awake mouse fMRI remains challenging despite extensive efforts to address motion-induced artifacts and stress. This study introduces an implantable radiofrequency (RF) surface coil design that minimizes image distortion caused by the air/tissue interface of mouse brains while simultaneously serving as a headpost for fixation during scanning. Using a 14T scanner, high-resolution fMRI enabled brain-wide functional mapping of visual and vibrissa stimulation at 100x100x200µm resolution with a 2s per frame sampling rate. Besides activated ascending visual and vibrissa pathways, robust BOLD responses were detected in the anterior cingulate cortex upon visual stimulation and spread through the ventral retrosplenial area (VRA) with vibrissa air-puff stimulation, demonstrating higher-order sensory processing in association cortices of awake mice. In particular, the rapid hemodynamic responses in VRA upon vibrissa stimulation showed a strong correlation with the hippocampus, thalamus, and prefrontal cortical areas. Cross-correlation analysis with designated VRA responses revealed early positive BOLD signals at the contralateral barrel cortex (BC) occurring 2 seconds prior to the air-puff in awake mice with repetitive stimulation, which was not detectable with the randomized stimulation paradigm. This early BC activation indicated learned anticipation through the vibrissa system and association cortices in awake mice under continuous training of repetitive air-puff stimulation. This work establishes a high-resolution awake mouse fMRI platform, enabling brain-wide functional mapping of sensory signal processing in higher association cortical areas. Significance StatementThis awake mouse fMRI platform was developed by implementing an advanced implantable radiofrequency (RF) coil scheme, which simultaneously served as a headpost to secure the mouse head during scanning. The ultra-high spatial resolution (100x100x200µm) BOLD fMRI enabled the brain-wide mapping of activated visual and vibrissa systems during sensory stimulation in awake mice, including association cortices, e.g. anterior cingulate cortex and retrosplenial cortex, for high order sensory processing. Also, the activation of barrel cortex at 2 s prior to the air-puff indicated a learned anticipation of awake mice under continuous training of the repetitive vibrissa stimulation. 
    more » « less
  5. ; ; ; ; (, Journal of Neurophysiology)
    null (Ed.)
    Detecting synaptic connections using large-scale extracellular spike recordings presents a statistical challenge. Although previous methods often treat the detection of each putative connection as a separate hypothesis test, here we develop a modeling approach that infers synaptic connections while incorporating circuit properties learned from the whole network. We use an extension of the generalized linear model framework to describe the cross-correlograms between pairs of neurons and separate correlograms into two parts: a slowly varying effect due to background fluctuations and a fast, transient effect due to the synapse. We then use the observations from all putative connections in the recording to estimate two network properties: the presynaptic neuron type (excitatory or inhibitory) and the relationship between synaptic latency and distance between neurons. Constraining the presynaptic neuron’s type, synaptic latencies, and time constants improves synapse detection. In data from simulated networks, this model outperforms two previously developed synapse detection methods, especially on the weak connections. We also apply our model to in vitro multielectrode array recordings from the mouse somatosensory cortex. Here, our model automatically recovers plausible connections from hundreds of neurons, and the properties of the putative connections are largely consistent with previous research. NEW & NOTEWORTHY Detecting synaptic connections using large-scale extracellular spike recordings is a difficult statistical problem. Here, we develop an extension of a generalized linear model that explicitly separates fast synaptic effects and slow background fluctuations in cross-correlograms between pairs of neurons while incorporating circuit properties learned from the whole network. This model outperforms two previously developed synapse detection methods in the simulated networks and recovers plausible connections from hundreds of neurons in in vitro multielectrode array data. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email