skip to main content


Title: Pinpointing the neural signatures of single-exposure visual recognition memory

Memories of the images that we have seen are thought to be reflected in the reduction of neural responses in high-level visual areas such as inferotemporal (IT) cortex, a phenomenon known as repetition suppression (RS). We challenged this hypothesis with a task that required rhesus monkeys to report whether images were novel or repeated while ignoring variations in contrast, a stimulus attribute that is also known to modulate the overall IT response. The monkeys’ behavior was largely contrast invariant, contrary to the predictions of an RS-inspired decoder, which could not distinguish responses to images that are repeated from those that are of lower contrast. However, the monkeys’ behavioral patterns were well predicted by a linearly decodable variant in which the total spike count was corrected for contrast modulation. These results suggest that the IT neural activity pattern that best aligns with single-exposure visual recognition memory behavior is not RS but rather sensory referenced suppression: reductions in IT population response magnitude, corrected for sensory modulation.

 
more » « less
NSF-PAR ID:
10224331
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
Proceedings of the National Academy of Sciences
Date Published:
Journal Name:
Proceedings of the National Academy of Sciences
Volume:
118
Issue:
18
ISSN:
0027-8424
Page Range / eLocation ID:
Article No. e2021660118
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    In noisy but stationary environments, decisions should be based on the temporal integration of sequentially sampled evidence. This strategy has been supported by many behavioral studies and is qualitatively consistent with neural activity in multiple brain areas. By contrast, decision-making in the face of non-stationary sensory evidence remains poorly understood. Here, we trained monkeys to identify and respond via saccade to the dominant color of a dynamically refreshed bicolor patch that becomes informative after a variable delay. Animals’ behavioral responses were briefly suppressed after evidence changes, and many neurons in the frontal eye field displayed a corresponding dip in activity at this time, similar to that frequently observed after stimulus onset but sensitive to stimulus strength. Generalized drift-diffusion models revealed consistency of behavior and neural activity with brief suppression of motor output, but not with pausing or resetting of evidence accumulation. These results suggest that momentary arrest of motor preparation is important for dynamic perceptual decision making.

     
    more » « less
  2. Abstract

    Although experimentally simulating predator presence helps improve sample sizes in studies of free‐ranging animals, few studies have examined whether auditory playbacks and visual models produce similar results. Additionally, it is unclear if anti‐predator strategies are specific to predator hunting styles in understudied Neotropical pitheciid primates, limiting what we can generalize about this phenomenon across this taxonomic order. We conducted predator simulation experiments to assess whether wild Rylands' bald‐faced saki monkeys (Pithecia rylandsi) recognize predators based solely on acoustic cues, exhibit predator‐specific responses to different predator types, and vary responses to presentations in different sensory modes. In our playback experiments, sakis had weak responses to non‐predator control vocalizations compared to jaguar growls and harpy eagle shrieks. In most predator playbacks, subjects' first glance corresponded to the direction from which simulated predators would typically attack (above vs. below). However, although sakis exhibited appropriate movement responses to harpy playbacks (i.e., descending canopy), they exhibited no clear movement patterns when presented with jaguar playbacks. In contrast, jaguar model experiments consistently elicited fast approaches, mobbing‐style responses, and long alarm calling bouts. Thus, if we had relied on playbacks alone, we might have concluded that sakis have only generalized responses to terrestrial ambush predators. In fact, in all variables measured (e.g., latency, number of calls, and response duration), models of both predator species elicited stronger reactions than playbacks. Results indicate that bald‐faced sakis can identify predators based solely on vocalizations, but do not exhibit predator‐specific escape responses to terrestrial predators based on acoustic cues alone. The differential response to playbacks and models calls into question the reliability of using acoustic‐only stimuli to assess the specificity of anti‐predator behavior to predator hunting styles in some primate species.

     
    more » « less
  3. Abstract

    Over the last decades, psychophysical and electrophysiological studies in patients and animal models of Parkinson’s disease (PD), have consistently revealed a number of visual abnormalities. In particular, specific alterations of contrast sensitivity curves, electroretinogram (ERG), and visual-evoked potentials (VEP), have been attributed to dopaminergic retinal depletion. However, fundamental mechanisms of cortical visual processing, such as normalization or “gain control” computations, have not yet been examined in PD patients. Here, we measured electrophysiological indices of gain control in both space (surround suppression) and time (sensory adaptation) in PD patients based on steady-state VEP (ssVEP). Compared with controls, patients exhibited a significantly higher initial ssVEP amplitude that quickly decayed over time, and greater relative suppression of ssVEP amplitude as a function of surrounding stimulus contrast. Meanwhile, EEG frequency spectra were broadly elevated in patients relative to controls. Thus, contrary to what might be expected given the reduced contrast sensitivity often reported in PD, visual neural responses are not weaker; rather, they are initially larger but undergo an exaggerated degree of spatial and temporal gain control and are embedded within a greater background noise level. These differences may reflect cortical mechanisms that compensate for dysfunctional center-surround interactions at the retinal level.

     
    more » « less
  4. Abstract

    Attention promotes the selection of behaviorally relevant sensory signals from the barrage of sensory information available. Visual attention modulates the gain of neuronal activity in all visual brain areas examined, although magnitudes of gain modulations vary across areas. For example, attention gain magnitudes in the dorsal lateral geniculate nucleus (LGN) and primary visual cortex (V1) vary tremendously across fMRI measurements in humans and electrophysiological recordings in behaving monkeys. We sought to determine whether these discrepancies are due simply to differences in species or measurement, or more nuanced properties unique to each visual brain area. We also explored whether robust and consistent attention effects, comparable to those measured in humans with fMRI, are observable in the LGN or V1 of monkeys. We measured attentional modulation of multiunit activity in the LGN and V1 of macaque monkeys engaged in a contrast change detection task requiring shifts in covert visual spatial attention. Rigorous analyses of LGN and V1 multiunit activity revealed robust and consistent attentional facilitation throughout V1, with magnitudes comparable to those observed with fMRI. Interestingly, attentional modulation in the LGN was consistently negligible. These findings demonstrate that discrepancies in attention effects are not simply due to species or measurement differences. We also examined whether attention effects correlated with the feature selectivity of recorded multiunits. Distinct relationships suggest that attentional modulation of multiunit activity depends upon the unique structure and function of visual brain areas.

     
    more » « less
  5. Identifying neural correlates of conscious perception is a fundamental endeavor of cognitive neuroscience. Most studies so far have focused on visual awareness along with trial-by-trial reports of task relevant stimuli, which can confound neural measures of perceptual awareness with post-perceptual processing. Here, we used a three-phase sine-wave speech paradigm that dissociated between conscious speech perception and task relevance while recording EEG in humans of both sexes. Compared to tokens perceived as noise, physically identical sine-wave speech tokens that were perceived as speech elicited a left-lateralized, near-vertex negativity, which we interpret as a phonological version of a perceptual awareness negativity. This response appeared between 200 and 300 ms after token onset and was not present for frequency-flipped control tokens that were never perceived as speech. In contrast, the P3b elicited by task-irrelevant tokens did not significantly differ when the tokens were perceived as speech versus noise, and was only enhanced for tokens that were both perceived as speechandrelevant to the task. Our results extend the findings from previous studies on visual awareness and speech perception, and suggest that correlates of conscious perception, across types of conscious content, are most likely to be found in mid-latency negative-going brain responses in content-specific sensory areas.

    Significance StatementHow patterns of brain activity give rise to conscious perception is a fundamental question of cognitive neuroscience. Here, we asked whether markers of conscious speech perception can be separated from task-related confounds. We combined sine-wave speech - a degraded speech signal that is heard as noise by naive individuals but can readily be heard as speech after minimal training - with a no-report paradigm that independently manipulated perception (speech versus non-speech) and task (relevant versus irrelevant). Using this paradigm, we were able to identify a marker of speech perception in mid-latency responses over left frontotemporal EEG channels that was independent of task. Our results demonstrate that the “perceptual awareness negativity” is present for a new type of perceptual content (speech).

     
    more » « less