Title: Efficient models of cortical activity via local dynamic equilibria and coarse-grained interactions
Biologically detailed models of brain circuitry are challenging to build and simulate due to the large number of neurons, their complex interactions, and the many unknown physiological parameters. Simplified mathematical models are more tractable, but harder to evaluate when too far removed from neuroanatomy/physiology. We propose that a multiscale model, coarse-grained (CG) while preserving local biological details, offers the best balance between biological realism and computability. This paper presents such a model. Generally, CG models focus on the interaction between groups of neurons—here termed “pixels”—rather than individual cells. In our case, dynamics are alternately updated at intra- and interpixel scales, with one informing the other, until convergence to equilibrium is achieved on both scales. An innovation is how we exploit the underlying biology: Taking advantage of the similarity in local anatomical structures across large regions of the cortex, we model intrapixel dynamics as a single dynamical system driven by “external” inputs. These inputs vary with events external to the pixel, but their ranges can be estimateda priori. Precomputing and tabulating all potential local responses speed up the updating procedure significantly compared to direct multiscale simulation. We illustrate our methodology using a model of the primate visual cortex. Except for local neuron-to-neuron variability (necessarily lost in any CG approximation) our model reproduces various features of large-scale network models at a tiny fraction of the computational cost. These include neuronal responses as a consequence of their orientation selectivity, a primary function of visual neurons.  more » « less
Award ID(s):
1821286 1901009
PAR ID:
10523271
Author(s) / Creator(s):
; ;
Publisher / Repository:
National Academy of Sciences
Date Published:
Journal Name:
Proceedings of the National Academy of Sciences
Volume:
121
Issue:
27
ISSN:
0027-8424
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Both experimenter-controlled stimuli and stimulus-independent variables impact cortical neural activity. A major hurdle to understanding neural representation is distinguishing between qualitatively different causes of the fluctuating population activity. We applied an unsupervised low-rank tensor decomposition analysis to the recorded population activity in the visual cortex of awake mice in response to repeated presentations of naturalistic visual stimuli. We found that neurons covaried largely independently of individual neuron stimulus response reliability and thus encoded both stimulus-driven and stimulus-independent variables. Importantly, a neuron’s response reliability and the neuronal coactivation patterns substantially reorganized for different external visual inputs. Analysis of recurrent balanced neural network models revealed that both the stimulus specificity and the mixed encoding of qualitatively different variables can arise from clustered external inputs. These results establish that coactive neurons with diverse response reliability mediate a mixed representation of stimulus-driven and stimulus-independent variables in the visual cortex. NEW & NOTEWORTHY V1 neurons covary largely independently of individual neuron’s response reliability. A single neuron’s response reliability imposes only a weak constraint on its encoding capabilities. Visual stimulus instructs a neuron’s reliability and coactivation pattern. Network models revealed using clustered external inputs. 
    more » « less
  2. Abstract: Neurons in higher-order visual areas integrate information through a canonical computation called normalization. The strength of normalization is highly heterogeneous across neurons, and this heterogeneity correlates with attention-mediated modulations in neural responses. However, the circuit mechanism underlying the heterogeneous normalization strength is unclear. In this work, we study normalization in a spiking neuron network model of visual cortex. Our model reveals that the heterogeneity of normalization strength is highly correlated with the inhibitory current each neuron receives. The correlation between inhibition and other synaptic inputs explains the experimentally observed dependence of spike count correlations on normalization strength. Further, we find that neurons with stronger normalization encode information more efficiently, and that networks with more heterogeneity in normalization have more information and higher capacity in encoding visual stimuli. Together, our model provides a mechanistic explanation of heterogeneous normalization strengths in the visual cortex, and sheds light on the computational benefits of neuronal heterogeneity. 
    more » « less
  3. Neurons in higher-order visual areas integrate information through a canonical computation called normalization. The strength of normalization is highly heterogeneous across neurons, and this heterogeneity correlates with attention-mediated modulations in neural responses. However, the circuit mechanism underlying the heterogeneous normalization strength is unclear. In this work, we study normalization in a spiking neuron network model of visual cortex. Our model reveals that the heterogeneity of normalization strength is highly correlated with the inhibitory current each neuron receives. The correlation between inhibition and other synaptic inputs explains the experimentally observed dependence of spike count correlations on normalization strength. Further, we find that neurons with stronger normalization encode information more efficiently, and that networks with more heterogeneity in normalization encode visual stimuli with higher information and capacity. Together, our model provides a mechanistic explanation of heterogeneous normalization strengths in the visual cortex and sheds light on the computational benefits of neuronal heterogeneity. 
    more » « less
  4. The frontal eye field (FEF) and posterior parietal cortex (PPC) are key hubs of the dorsal attention network, yet how parietal inputs shape prefrontal circuit temporal dynamics and attentional computations remains largely unknown. We measured intrinsic timescales of FEF neurons in male rhesus macaques and examined their changes during PPC inactivation. We observed two distinct classes of FEF neurons based on their intrinsic timescales: short-timescale neurons (~25 ms) and long-timescale neurons (~100 ms). Short-timescale neurons showed stronger transient visual responses, suggesting a role in rapid visual processing. In contrast, long-timescale neurons exhibited stronger sustained salience representation, suggesting a role in spatiotemporal integration to maintain stimulus-driven attention. During PPC inactivation, intrinsic timescales increased in both neuron types, with a substantially larger effect in short-timescale neurons. In addition, PPC inactivation selectively disrupted salience computation, particularly in long-timescale neurons. These findings provide causal evidence linking intrinsic local neural timescales to long-range inter-area communication and indicate the presence of at least two distinct network motifs that support different neuronal dynamics and functional computations within the FEF. 
    more » « less
  5. Soltani, Alireza (Ed.)
    Feedforward network models performing classification tasks rely on highly convergent output units that collect the information passed on by preceding layers. Although convergent output-unit like neurons may exist in some biological neural circuits, notably the cerebellar cortex, neocortical circuits do not exhibit any obvious candidates for this role; instead they are highly recurrent. We investigate whether a sparsely connected recurrent neural network (RNN) can perform classification in a distributed manner without ever bringing all of the relevant information to a single convergence site. Our model is based on a sparse RNN that performs classification dynamically. Specifically, the interconnections of the RNN are trained to resonantly amplify the magnitude of responses to some external inputs but not others. The amplified and non-amplified responses then form the basis for binary classification. Furthermore, the network acts as an evidence accumulator and maintains its decision even after the input is turned off. Despite highly sparse connectivity, learned recurrent connections allow input information to flow to every neuron of the RNN, providing the basis for distributed computation. In this arrangement, the minimum number of synapses per neuron required to reach maximum memory capacity scales only logarithmically with network size. The model is robust to various types of noise, works with different activation and loss functions and with both backpropagation- and Hebbian-based learning rules. The RNN can also be constructed with a split excitation-inhibition architecture with little reduction in performance. 
    more » « less