skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: How biological attention mechanisms improve task performance in a large-scale visual system model
Imagine you have lost your cell phone. Your eyes scan the cluttered table in front of you, searching for its familiar blue case. But what is happening within the visual areas of your brain while you search? One possibility is that neurons that represent relevant features such as 'blue' and 'rectangular' increase their activity. This might help you spot your phone among all the other objects on the table. Paying attention to specific features improves our performance on visual tasks that require detecting those features. The 'feature similarity gain model' proposes that this is because attention increases the activity of neurons sensitive to specific target features, such as ‘blue’ in the example above. But is this how the brain solves such challenges in practice? Previous studies examining this issue have relied on correlations. They have shown that increases in neural activity correlate with improved performance on visual tasks. But correlation does not imply causation. Lindsay and Miller have now used a computer model of the brain’s visual pathway to examine whether changes in neural activity cause improved performance. The model was trained to use feature similarity gain to detect an object within a set of photographs. As predicted, changes in activity like those that occur in the brain did indeed improve the model’s performance. Moreover, activity changes at later stages of the model's processing pathway produced bigger improvements than activity changes earlier in the pathway. This may explain why attention affects neural activity more at later stages in the visual pathway. But feature similarity gain is not the only possible explanation for the results. Lindsay and Miller show that another pattern of activity change also enhanced the model’s performance, and propose an experiment to distinguish between the two possibilities. Overall, these findings increase our understanding of how the brain processes sensory information. Work is ongoing to teach computers to process images as efficiently as the human visual system. The computer model used in this study is similar to those used in state-of-the-art computer vision. These findings could thus help advance artificial sensory processing too.  more » « less
Award ID(s):
1707398 1704938
PAR ID:
10083393
Author(s) / Creator(s):
;
Date Published:
Journal Name:
eLife
Volume:
7
ISSN:
2050-084X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Microglia transform in response to changes in sensory or neural activity, such as sensory deprivation. However, little is known about how specific frequencies of neural activity, or brain rhythms, affect microglia and cytokine signaling. Using visual noninvasive flickering sensory stimulation (flicker) to induce electrical neural activity at 40 hertz, within the gamma band, and 20 hertz, within the beta band, we found that these brain rhythms differentially affect microglial morphology and cytokine expression in healthy animals. Flicker induced expression of certain cytokines independently of microglia, including interleukin-10 and macrophage colony-stimulating factor. We hypothesized that nuclear factor κB (NF-κB) plays a causal role in frequency-specific cytokine and microglial responses because this pathway is activated by synaptic activity and regulates cytokines. After flicker, phospho–NF-κB colabeled with neurons more than microglia. Inhibition of NF-κB signaling down-regulated flicker-induced cytokine expression and attenuated flicker-induced changes in microglial morphology. These results reveal a mechanism through which brain rhythms affect brain function by altering microglial morphology and cytokines via NF-κB. 
    more » « less
  2. Abstract We build on the existing biased competition view to argue that attention is anemergentproperty of neural computations within and across hierarchically embedded and structurally connected cortical pathways. Critically then, one must ask,what is attention emergent from? Within this framework, developmental changes in the quality of sensory input and feedforward‐feedback information flow shape the emergence and efficiency of attention. Several gradients of developing structural and functional cortical architecture across the caudal‐to‐rostral axis provide the substrate for attention to emerge. Neural activity within visual areas depends on neuronal density, receptive field size, tuning properties of neurons, and the location of and competition between features and objects in the visual field. These visual cortical properties highlight the information processing bottleneck attention needs to resolve. Recurrent feedforward and feedback connections convey sensory information through a series of steps at each level of the cortical hierarchy, integrating sensory information across the entire extent of the cortical hierarchy and linking sensory processing to higher‐order brain regions. Higher‐order regions concurrently provide input conveying behavioral context and goals. Thus, attention reflects the output of a series of complex biased competition neural computations that occur within and across hierarchically embedded cortical regions. Cortical development proceeds along the caudal‐to‐rostral axis, mirroring the flow in sensory information from caudal to rostral regions, and visual processing continues to develop into childhood. Examining both typical and atypical development will offer critical mechanistic insight not otherwise available in the adult stable state. This article is categorized under:Psychology > Attention 
    more » « less
  3. A notable feature of neural activity is sparseness – namely, that only a small fraction of neurons in a local circuit have high activity at any moment. Not only is sparse neural activity observed experimentally in most areas of the brain, but sparseness has been proposed as an optimization or design principle for neural circuits. Sparseness can increase the energy efficiency of the neural code as well as allow for beneficial computations to be carried out. But how does the brain achieve sparseness? Here, we found that when neurons in the primary visual cortex were passively exposed to a set of images over several days, neural responses became more sparse. Sparsification was driven by a decrease in the response of neurons with low or moderate activity, while highly activeneurons retained similar responses. We also observed a net decorrelation of neural activity. These changes sculptneural activity for greater coding efficiency. 
    more » « less
  4. Abstract Selective attention improves sensory processing of relevant information but can also impact the quality of perception. For example, attention increases visual discrimination performance and at the same time boosts apparent stimulus contrast of attended relative to unattended stimuli. Can attention also lead to perceptual distortions of visual representations? Optimal tuning accounts of attention suggest that processing is biased towards “off-tuned” features to maximize the signal-to-noise ratio in favor of the target, especially when targets and distractors are confusable. Here, we tested whether such tuning gives rise to phenomenological changes of visual features. We instructed participants to select a color among other colors in a visual search display and subsequently asked them to judge the appearance of the target color in a 2-alternative forced choice task. Participants consistently judged the target color to appear more dissimilar from the distractor color in feature space. Critically, the magnitude of these perceptual biases varied systematically with the similarity between target and distractor colors during search, indicating that attentional tuning quickly adapts to current task demands. In control experiments we rule out possible non-attentional explanations such as color contrast or memory effects. Overall, our results demonstrate that selective attention warps the representational geometry of color space, resulting in profound perceptual changes across large swaths of feature space. Broadly, these results indicate that efficient attentional selection can come at a perceptual cost by distorting our sensory experience. 
    more » « less
  5. In models of visual spatial attention control, it is commonly held that top–down control signals originate in the dorsal attention network, propagating to the visual cortex to modulate baseline neural activity and bias sensory processing. However, the precise distribution of these top–down influences across different levels of the visual hierarchy is debated. In addition, it is unclear whether these baseline neural activity changes translate into improved performance. We analyzed attention-related baseline activity during the anticipatory period of a voluntary spatial attention task, using two independent functional magnetic resonance imaging datasets and two analytic approaches. First, as in prior studies, univariate analysis showed that covert attention significantly enhanced baseline neural activity in higher-order visual areas contralateral to the attended visual hemifield, while effects in lower-order visual areas (e.g., V1) were weaker and more variable. Second, in contrast, multivariate pattern analysis (MVPA) revealed significant decoding of attention conditions across all visual cortical areas, with lower-order visual areas exhibiting higher decoding accuracies than higher-order areas. Third, decoding accuracy, rather than the magnitude of univariate activation, was a better predictor of a subject's stimulus discrimination performance. Finally, the MVPA results were replicated across two experimental conditions, where the direction of spatial attention was either externally instructed by a cue or based on the participants’ free choice decision about where to attend. Together, these findings offer new insights into the extent of attentional biases in the visual hierarchy under top–down control and how these biases influence both sensory processing and behavioral performance. 
    more » « less