More Like this

1. A neuronal code for object representation and memory in the human amygdala and hippocampus

   https://doi.org/10.1038/s41467-025-56793-y  

   Cao, Runnan; Brunner, Peter; Chakravarthula, Puneeth N; Wahlstrom, Krista L; Inman, Cory; Smith, Elliot H; Li, Xin; Mamelak, Adam N; Brandmeir, Nicholas J; Rutishauser, Ueli; et al (December 2025, Nature Communications)

   Abstract How the brain encodes, recognizes, and memorizes general visual objects is a fundamental question in neuroscience. Here, we investigated the neural processes underlying visual object perception and memory by recording from 3173 single neurons in the human amygdala and hippocampus across four experiments. We employed both passive-viewing and recognition memory tasks involving a diverse range of naturalistic object stimuli. Our findings reveal a region-based feature code for general objects, where neurons exhibit receptive fields in the high-level visual feature space. This code can be validated by independent new stimuli and replicated across all experiments, including fixation-based analyses with large natural scenes. This region code explains the long-standing visual category selectivity, preferentially enhances memory of encoded stimuli, predicts memory performance, encodes image memorability, and exhibits intricate interplay with memory contexts. Together, region-based feature coding provides an important mechanism for visual object processing in the human brain. 

   more » « less
2. Complementary congruent and opposite neurons achieve concurrent multisensory integration and segregation

   https://doi.org/10.7554/eLife.43753  

   Zhang, Wen-Hao; Wang, He; Chen, Aihua; Gu, Yong; Lee, Tai Sing; Wong, KY Michael; Wu, Si (May 2019, eLife)

   Our brain perceives the world by exploiting multisensory cues to extract information about various aspects of external stimuli. The sensory cues from the same stimulus should be integrated to improve perception, and otherwise segregated to distinguish different stimuli. In reality, however, the brain faces the challenge of recognizing stimuli without knowing in advance the sources of sensory cues. To address this challenge, we propose that the brain conducts integration and segregation concurrently with complementary neurons. Studying the inference of heading-direction via visual and vestibular cues, we develop a network model with two reciprocally connected modules modeling interacting visual-vestibular areas. In each module, there are two groups of neurons whose tunings under each sensory cue are either congruent or opposite. We show that congruent neurons implement integration, while opposite neurons compute cue disparity information for segregation, and the interplay between two groups of neurons achieves efficient multisensory information processing. 

   more » « less
3. Feature-based attention warps the perception of visual features

   https://doi.org/10.1038/s41598-023-33488-2  

   Chapman, Angus F.; Chunharas, Chaipat; Störmer, Viola S. (December 2023, Scientific Reports)

   Abstract Selective attention improves sensory processing of relevant information but can also impact the quality of perception. For example, attention increases visual discrimination performance and at the same time boosts apparent stimulus contrast of attended relative to unattended stimuli. Can attention also lead to perceptual distortions of visual representations? Optimal tuning accounts of attention suggest that processing is biased towards “off-tuned” features to maximize the signal-to-noise ratio in favor of the target, especially when targets and distractors are confusable. Here, we tested whether such tuning gives rise to phenomenological changes of visual features. We instructed participants to select a color among other colors in a visual search display and subsequently asked them to judge the appearance of the target color in a 2-alternative forced choice task. Participants consistently judged the target color to appear more dissimilar from the distractor color in feature space. Critically, the magnitude of these perceptual biases varied systematically with the similarity between target and distractor colors during search, indicating that attentional tuning quickly adapts to current task demands. In control experiments we rule out possible non-attentional explanations such as color contrast or memory effects. Overall, our results demonstrate that selective attention warps the representational geometry of color space, resulting in profound perceptual changes across large swaths of feature space. Broadly, these results indicate that efficient attentional selection can come at a perceptual cost by distorting our sensory experience. 

   more » « less
4. The Ventral Attention Network Mediates Attentional Reorienting to Cross-Modal Expectancy Violations: Evidence from EEG and fMRI

   https://doi.org/10.1523/JNEUROSCI.0720-25.2026  

   Das, Soukhin; Meyyappan, Sreenivasan; Bekker, Evelijne M; Corina, Sharon; Ding, Mingzhou; Mangun, George R (February 2026, The Journal of Neuroscience)

   Our daily interactions with the world are shaped by sensory expectations informed by context and prior experiences, which in turn influence how we allocate our attention. Prominent predictive coding models suggest that sensory expectancy and attention interact but disagree on the precise mechanisms. One possibility is that the ventral attention network (VAN) may play a role by facilitating attentional reorienting when expectancy is violated. To test this in humans (23 males and 43 females), we employed an auditory-visual trial-by-trial cueing paradigm in three experiments integrating EEG and fMRI to investigate the VAN’s role in violations of cross-modal expectancy. Behavioral results showed faster responses to expected targets, confirming the efficacy of cue-induced expectations in orienting attention to the expected target modality. EEG analyses revealed differences in early (∼100 ms latency) event-related potentials (ERPs) to both auditory and visual stimuli when expectations were violated. Unexpected stimuli elicited significantly larger early-latency negative ERPs, across both modalities. Source localization of these ERPs and subsequent fMRI evidence revealed activation in the right VAN. Functional connectivity analyses showed greater coupling between VAN regions and sensory cortices, with modality-specific pathways involving superior temporal gyrus for auditory and fusiform gyrus for visual targets. These findings demonstrate that expectancy violations recruit the VAN to reorient attention and resolve sensory conflict. By coordinating top-down control and bottom-up sensory input, the VAN supports adaptive responses to unexpected stimuli. This work advances our understanding of predictive processing in multisensory perception and highlights the VAN’s central role in flexible cognitive control. 

   more » « less
5. Feature-coding transitions to conjunction-coding with progression through human visual cortex

   https://doi.org/10.1152/jn.00503.2017  

   Cowell, Rosemary A; Leger, Krystal R; Serences, John T (December 2017, Journal of Neurophysiology)

   Identifying an object and distinguishing it from similar items depends upon the ability to perceive its component parts as conjoined into a cohesive whole, but the brain mechanisms underlying this ability remain elusive. The ventral visual processing pathway in primates is organized hierarchically: Neuronal responses in early stages are sensitive to the manipulation of simple visual features, whereas neuronal responses in subsequent stages are tuned to increasingly complex stimulus attributes. It is widely assumed that feature-coding dominates in early visual cortex whereas later visual regions employ conjunction-coding in which object representations are different from the sum of their simple feature parts. However, no study in humans has demonstrated that putative object-level codes in higher visual cortex cannot be accounted for by feature-coding and that putative feature codes in regions prior to ventral temporal cortex are not equally well characterized as object-level codes. Thus the existence of a transition from feature- to conjunction-coding in human visual cortex remains unconfirmed, and if a transition does occur its location remains unknown. By employing multivariate analysis of functional imaging data, we measure both feature-coding and conjunction-coding directly, using the same set of visual stimuli, and pit them against each other to reveal the relative dominance of one vs. the other throughout cortex. Our results reveal a transition from feature-coding in early visual cortex to conjunction-coding in both inferior temporal and posterior parietal cortices. This novel method enables the use of experimentally controlled stimulus features to investigate population-level feature and conjunction codes throughout human cortex. NEW & NOTEWORTHY We use a novel analysis of neuroimaging data to assess representations throughout visual cortex, revealing a transition from feature-coding to conjunction-coding along both ventral and dorsal pathways. Occipital cortex contains more information about spatial frequency and contour than about conjunctions of those features, whereas inferotemporal and parietal cortices contain conjunction coding sites in which there is more information about the whole stimulus than its component parts. 

   more » « less