An official website of the United States government
Abstract Learning appropriate representations of the reward environment is challenging in the real world where there are many options, each with multiple attributes or features. Despite existence of alternative solutions for this challenge, neural mechanisms underlying emergence and adoption of value representations and learning strategies remain unknown. To address this, we measure learning and choice during a multi-dimensional probabilistic learning task in humans and trained recurrent neural networks (RNNs) to capture our experimental observations. We find that human participants estimate stimulus-outcome associations by learning and combining estimates of reward probabilities associated with the informative feature followed by those of informative conjunctions. Through analyzing representations, connectivity, and lesioning of the RNNs, we demonstrate this mixed learning strategy relies on a distributed neural code and opponency between excitatory and inhibitory neurons through value-dependent disinhibition. Together, our results suggest computational and neural mechanisms underlying emergence of complex learning strategies in naturalistic settings.
more »
« less
Encoding time in neural dynamic regimes with distinct computational tradeoffs
Converging evidence suggests the brain encodes time in dynamic patterns of neural activity, including neural sequences, ramping activity, and complex dynamics. Most temporal tasks, however, require more than just encoding time, and can have distinct computational requirements including the need to exhibit temporal scaling, generalize to novel contexts, or robustness to noise. It is not known how neural circuits can encode time and satisfy distinct computational requirements, nor is it known whether similar patterns of neural activity at the population level can exhibit dramatically different computational or generalization properties. To begin to answer these questions, we trained RNNs on two timing tasks based on behavioral studies. The tasks had different input structures but required producing identically timed output patterns. Using a novel framework we quantified whether RNNs encoded two intervals using either of three different timing strategies: scaling, absolute, or stimulus-specific dynamics. We found that similar neural dynamic patterns at the level of single intervals, could exhibit fundamentally different properties, including, generalization, the connectivity structure of the trained networks, and the contribution of excitatory and inhibitory neurons. Critically, depending on the task structure RNNs were better suited for generalization or robustness to noise. Further analysis revealed different connection patterns underlying the different regimes. Our results predict that apparently similar neural dynamic patterns at the population level (e.g., neural sequences) can exhibit fundamentally different computational properties in regards to their ability to generalize to novel stimuli and their robustness to noise—and that these differences are associated with differences in network connectivity and distinct contributions of excitatory and inhibitory neurons. We also predict that the task structure used in different experimental studies accounts for some of the experimentally observed variability in how networks encode time.
more »
« less
- Award ID(s):
- 2008741
- PAR ID:
- 10348980
- Editor(s):
- Gutkin, Boris S.
- Date Published:
- Journal Name:
- PLOS Computational Biology
- Volume:
- 18
- Issue:
- 3
- ISSN:
- 1553-7358
- Page Range / eLocation ID:
- e1009271
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Prefrontal cortex (PFC) are broadly linked to various aspects of behavior. During sensory discrimination, PFC neurons can encode a range of task related information, including the identity of sensory stimuli and related behavioral outcome. However, it remains largely unclear how different neuron subtypes and local field potential (LFP) oscillation features in the mouse PFC are modulated during sensory discrimination. To understand how excitatory and inhibitory PFC neurons are selectively engaged during sensory discrimination and how their activity relates to LFP oscillations, we used tetrode recordings to probe well-isolated individual neurons, and LFP oscillations, in mice performing a three-choice auditory discrimination task. We found that a majority of PFC neurons, 78% of the 711 recorded individual neurons, exhibited sensory discrimination related responses that are context and task dependent. Using spike waveforms, we classified these responsive neurons into putative excitatory neurons with broad waveforms or putative inhibitory neurons with narrow waveforms, and found that both neuron subtypes were transiently modulated, with individual neurons’ responses peaking throughout the entire duration of the trial. While the number of responsive excitatory neurons remain largely constant throughout the trial, an increasing fraction of inhibitory neurons were gradually recruited as the trial progressed. Further examination of the coherence between individual neurons and LFPs revealed that inhibitory neurons exhibit higher spike-field coherence with LFP oscillations than excitatory neurons during all aspects of the trial and across multiple frequency bands. Together, our results demonstrate that PFC excitatory neurons are continuously engaged during sensory discrimination, whereas PFC inhibitory neurons are increasingly recruited as the trial progresses and preferentially coordinated with LFP oscillations. These results demonstrate increasing involvement of inhibitory neurons in shaping the overall PFC dynamics toward the completion of the sensory discrimination task.more » « less
-
null (Ed.)Trace conditioning and extinction learning depend on the hippocampus, but it remains unclear how neural activity in the hippocampus is modulated during these two different behavioral processes. To explore this question, we performed calcium imaging from a large number of individual CA1 neurons during both trace eye-blink conditioning and subsequent extinction learning in mice. Our findings reveal that distinct populations of CA1 cells contribute to trace conditioned learning versus extinction learning, as learning emerges. Furthermore, we examined network connectivity by calculating co-activity between CA1 neuron pairs and found that CA1 network connectivity patterns also differ between conditioning and extinction, even though the overall connectivity density remains constant. Together, our results demonstrate that distinct populations of hippocampal CA1 neurons, forming different sub-networks with unique connectivity patterns, encode different aspects of learning.more » « less
-
Recurrent neural networks (RNNs) trained on a diverse ensemble of cognitive tasks, as described by Yang et al. (2019); Khona et al. (2023), have been shown to exhibit functional modularity, where neurons organize into discrete functional clusters, each specialized for specific shared computational subtasks. However, these RNNs do not demonstrate anatomical modularity, where these functionally specialized clusters also have a distinct spatial organization. This contrasts with the human brain which has both functional and anatomical modularity. Is there a way to train RNNs to make them more like brains in this regard? We apply a recent machine learning method, brain-inspired modular training (BIMT), to encourage neural connectivity to be local in space. Consequently, hidden neuron organization of the RNN forms spatial structures reminiscent of those of the brain: spatial clusters which correspond to functional clusters. Compared to standard L1 regularization and absence of regularization, BIMT exhibits superior performance by optimally balancing between task performance and sparsity. This balance is quantified both in terms of the number of active neurons and the cumulative wiring length. In addition to achieving brain-like organization in RNNs, our findings also suggest that BIMT holds promise for applications in neuromorphic computing and enhancing the interpretability of neural network architectures.more » « less
-
Mammalian cortex features a vast diversity of neuronal cell types, each with characteristic anatomical, molecular and functional properties. Synaptic connectivity powerfully shapes how each cell type participates in the cortical circuit, but mapping connectivity rules at the resolution of distinct cell types remains difficult. Here, we used millimeter-scale volumetric electron microscopy1to investigate the connectivity of all inhibitory neurons across a densely-segmented neuronal population of 1352 cells spanning all layers of mouse visual cortex, producing a wiring diagram of inhibitory connections with more than 70,000 synapses. Taking a data-driven approach inspired by classical neuroanatomy, we classified inhibitory neurons based on the relative targeting of dendritic compartments and other inhibitory cells and developed a novel classification of excitatory neurons based on the morphological and synaptic input properties. The synaptic connectivity between inhibitory cells revealed a novel class of disinhibitory specialist targeting basket cells, in addition to familiar subclasses. Analysis of the inhibitory connectivity onto excitatory neurons found widespread specificity, with many interneurons exhibiting differential targeting of certain subpopulations spatially intermingled with other potential targets. Inhibitory targeting was organized into “motif groups,” diverse sets of cells that collectively target both perisomatic and dendritic compartments of the same excitatory targets. Collectively, our analysis identified new organizing principles for cortical inhibition and will serve as a foundation for linking modern multimodal neuronal atlases with the cortical wiring diagram.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1371/journal.pcbi.1009271
