skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A neural circuit model for a contextual association task inspired by recommender systems
Abstract Behavioral data shows that humans and animals have the capacity to learn rules of associations applied to specific examples, and generalize these rules to a broad variety of contexts. This article focuses on neural circuit mechanisms to perform a context‐dependent association task that requires linking sensory stimuli to behavioral responses and generalizing to multiple other symmetrical contexts. The model uses neural gating units that regulate the pattern of physiological connectivity within the circuit. These neural gating units can be used in a learning framework that performs low‐rank matrix factorization analogous to recommender systems, allowing generalization with high accuracy to a wide range of additional symmetrical contexts. The neural gating units are trained with a biologically inspired framework involving traces of Hebbian modification that are updated based on the correct behavioral output of the network. This modeling demonstrates potential neural mechanisms for learning context‐dependent association rules and for the change in selectivity of neurophysiological responses in the hippocampus. The proposed computational model is evaluated using simulations of the learning process and the application of the model to new stimuli. Further, human subject behavioral experiments were performed and the results validate the key observation of a low‐rank synaptic matrix structure linking stimuli to responses.  more » « less
Award ID(s):
1664644 1914792 1645681
PAR ID:
10458573
Author(s) / Creator(s):
 ;  ;  ;  ;  
Publisher / Repository:
Wiley Blackwell (John Wiley & Sons)
Date Published:
Journal Name:
Hippocampus
Volume:
30
Issue:
4
ISSN:
1050-9631
Page Range / eLocation ID:
p. 384-395
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Learning to anticipate potentially dangerous contexts is an adaptive behavioral response to coping with stressors. An animal’s stress coping style (e.g. proactive–reactive axis) is known to influence how it encodes salient events. However, the neural and molecular mechanisms underlying these stress coping style differences in learning are unknown. Further, while a number of neuroplasticity-related genes have been associated with alternative stress coping styles, it is unclear if these genes may bias the development of conditioned behavioral responses to stressful stimuli, and if so, which brain regions are involved. Here, we trained adult zebrafish to associate a naturally aversive olfactory cue with a given context. Next, we investigated if expression of two neural plasticity and neurotransmission-related genes ( npas4a and gabbr1a ) were associated with the contextual fear conditioning differences between proactive and reactive stress coping styles. Reactive zebrafish developed a stronger conditioned fear response and showed significantly higher npas4a expression in the medial and lateral zones of the dorsal telencephalon (Dm, Dl), and the supracommissural nucleus of the ventral telencephalon (Vs). Our findings suggest that the expression of activity-dependent genes like npas4a may be differentially expressed across several interconnected forebrain regions in response to fearful stimuli and promote biases in fear learning among different stress coping styles. 
    more » « less
  2. Animals must weigh competing needs and states to generate adaptive behavioral responses to the environment. Sensorimotor circuits are thus tasked with integrating diverse external and internal cues relevant to these needs to generate context-appropriate behaviors. However, the mechanisms that underlie this integration are largely unknown. Here, we show that a wide range of states and stimuli converge upon a single Caenorhabditis elegans olfactory neuron to modulate food-seeking behavior. Using an unbiased ribotagging approach, we find that the expression of olfactory receptor genes in the AWA olfactory neuron is influenced by a wide array of states and stimuli, including feeding state, physiological stress, and recent sensory cues. We identify odorants that activate these state-dependent olfactory receptors and show that altered expression of these receptors influences food-seeking and foraging. Further, we dissect the molecular and neural circuit pathways through which external sensory information and internal nutritional state are integrated by AWA. This reveals a modular organization in which sensory and state-related signals arising from different cell types in the body converge on AWA and independently control chemoreceptor expression. The synthesis of these signals by AWA allows animals to generate sensorimotor responses that reflect the animal’s overall state. Our findings suggest a general model in which sensory- and state-dependent transcriptional changes at the sensory periphery modulate animals’ sensorimotor responses to meet their ongoing needs and states. 
    more » « less
  3. Animal brains evolved to optimize behavior in dynamic environments, flexibly selecting actions that maximize future rewards in different contexts. A large body of experimental work indicates that such optimization changes the wiring of neural circuits, appropriately mapping environmental input onto behavioral outputs. A major unsolved scientific question is how optimal wiring adjustments, which must target the connections responsible for rewards, can be accomplished when the relation between sensory inputs, action taken, environmental context with rewards is ambiguous. The credit assignment problem can be categorized into context-independent structural credit assignment and context-dependent continual learning. In this perspective, we survey prior approaches to these two problems and advance the notion that the brain’s specialized neural architectures provide efficient solutions. Within this framework, the thalamus with its cortical and basal ganglia interactions serves as a systems-level solution to credit assignment. Specifically, we propose that thalamocortical interaction is the locus of meta-learning where the thalamus provides cortical control functions that parametrize the cortical activity association space. By selecting among these control functions, the basal ganglia hierarchically guide thalamocortical plasticity across two timescales to enable meta-learning. The faster timescale establishes contextual associations to enable behavioral flexibility while the slower one enables generalization to new contexts. 
    more » « less
  4. Central to the navigation of an ever-changing environment is the ability to form positive associations with places and conspecifics. The functions of location and social conditioned preferences are often studied independently, limiting our understanding of their interplay. Furthermore, a de-emphasis on natural functions of conditioned preferences has led to neurobiological interpretations separated from ecological context. By adopting a naturalistic and ethological perspective, we uncover complexities underlying the expression of conditioned preferences. Development of conditioned preferences is a combination of motivation, reward, associative learning, and context, including for social and spatial environments. Both social- and location-dependent reward-responsive behaviors and their conditioning rely on internal state-gating mechanisms that include neuroendocrine and hormone systems such as opioids, dopamine, testosterone, estradiol, and oxytocin. Such reinforced behavior emerges from mechanisms integrating past experience and current social and environmental conditions. Moreover, social context, environmental stimuli, and internal state gate and modulate motivation and learning via associative reward, shaping the conditioning process. We highlight research incorporating these concepts, focusing on the integration of social neuroendocrine mechanisms and behavioral conditioning. We explore three paradigms: 1) conditioned place preference, 2) conditioned social preference, and 3) social conditioned place preference. We highlight nonclassical species to emphasize the naturalistic applications of these conditioned preferences. To fully appreciate the complex integration of spatial and social information, future research must identify neural networks where endocrine systems exert influence on such behaviors. Such research promises to provide valuable insights into conditioned preferences within a broader naturalistic context. 
    more » « less
  5. To adapt to their environments, animals must generate behaviors that are closely aligned to a rapidly changing sensory world. However, behavioral states such as foraging or courtship typically persist over long time scales to ensure proper execution. It remains unclear how neural circuits generate persistent behavioral states while maintaining the flexibility to select among alternative states when the sensory context changes. Here, we elucidate the functional architecture of a neural circuit controlling the choice between roaming and dwelling states, which underlie exploration and exploitation during foraging in C. elegans . By imaging ensemble-level neural activity in freely moving animals, we identify stereotyped changes in circuit activity corresponding to each behavioral state. Combining circuit-wide imaging with genetic analysis, we find that mutual inhibition between two antagonistic neuromodulatory systems underlies the persistence and mutual exclusivity of the neural activity patterns observed in each state. Through machine learning analysis and circuit perturbations, we identify a sensory processing neuron that can transmit information about food odors to both the roaming and dwelling circuits and bias the animal towards different states in different sensory contexts, giving rise to context-appropriate state transitions. Our findings reveal a potentially general circuit architecture that enables flexible, sensory-driven control of persistent behavioral states. 
    more » « less