We investigated how the human brain integrates experiences of specific events to build general knowledge about typical event structure. We examined an episodic memory area important for temporal relations, anterior-lateral entorhinal cortex, and a semantic memory area important for action concepts, middle temporal gyrus, to understand how and when these areas contribute to these processes. Participants underwent functional magnetic resonance imaging while learning and recalling temporal relations among novel events over two sessions 1 week apart. Across distinct contexts, individual temporal relations among events could either be consistent or inconsistent with each other. Within each context, during the recall phase, we measured associative coding as the difference of multivoxel correlations among related vs unrelated pairs of events. Neural regions that form integrative representations should exhibit stronger associative coding in the consistent than the inconsistent contexts. We found evidence of integrative representations that emerged quickly in anterior-lateral entorhinal cortex (at session 1), and only subsequently in middle temporal gyrus, which showed a significant change across sessions. A complementary pattern of findings was seen with signatures during learning. This suggests that integrative representations are established early in anterior-lateral entorhinal cortex and may be a pathway to the later emergence of semantic knowledge in middle temporal gyrus.
Encoding an event that overlaps with a previous experience may involve reactivating an existing memory and integrating it with new information or suppressing the existing memory to promote formation of a distinct, new representation. We used fMRI during overlapping event encoding to track reactivation and suppression of individual, related memories. We further used a model of semantic knowledge based on Wikipedia to quantify both reactivation of semantic knowledge related to a previous event and formation of integrated memories containing semantic features of both events. Representational similarity analysis revealed that reactivation of semantic knowledge related to a prior event in posterior medial prefrontal cortex (pmPFC) supported memory integration during new learning. Moreover, anterior hippocampus (aHPC) formed integrated representations combining the semantic features of overlapping events. We further found evidence that aHPC integration may be modulated on a trial-by-trial basis by interactions between ventrolateral PFC and anterior mPFC, with suppression of item-specific memory representations in anterior mPFC inhibiting hippocampal integration. These results suggest that PFC-mediated control processes determine the availability of specific relevant memories during new learning, thus impacting hippocampal memory integration.
more » « less- NSF-PAR ID:
- 10418485
- Publisher / Repository:
- Oxford University Press
- Date Published:
- Journal Name:
- Cerebral Cortex
- Volume:
- 33
- Issue:
- 14
- ISSN:
- 1047-3211
- Page Range / eLocation ID:
- p. 9020-9037
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
Abstract -
null ; Mangun, G.R. ; Gazzaniga, M.S. (Ed.)The human ability to remember unique experiences from many years ago comes so naturally that we often take it for granted. It depends on three stages: (1) encoding, when new information is initially registered, (2) storage, when encoded information is held in the brain, and (3) retrieval, when stored information is used. Historically, cognitive neuroscience studies of memory have emphasized encoding and retrieval. Yet, the intervening stage may hold the most intrigue, and has become a major research focus in the years since the last edition of this book. Here we describe recent investigations of post-acquisition memory processing in relation to enduring storage. This evidence of memory processing belies the notion that memories stored in the brain are held in stasis, without changing. Various methods for influencing and monitoring brain activity have been applied to study offline memory processing. In particular, memories can be reactivated during sleep and during resting periods, with distinctive physiological correlates. These neural signals shed light on the contribution of hippocampal-neocortical interactions to memory consolidation. Overall, results converge on the notion that memory reactivation is a critical determinant of systems-level consolidation, and thus of future remembering, which in turn facilitates future planning and problem solving.more » « less
-
more » « less
Neuroimaging studies of human memory have consistently found that univariate responses in parietal cortex track episodic experience with stimuli (whether stimuli are 'old' or 'new'). More recently, pattern-based fMRI studies have shown that parietal cortex also carries information about the semantic content of remembered experiences. However, it is not well understood how memory-based and content-based signals are integrated within parietal cortex. Here, in humans (males and females), we used voxel-wise encoding models and a recognition memory task to predict the fMRI activity patterns evoked by complex natural scene images based on (1) the episodic history and (2) the semantic content of each image. Models were generated and compared across distinct subregions of parietal cortex and for occipitotemporal cortex. We show that parietal and occipitotemporal regions each encode memory and content information, but they differ in how they combine this information. Among parietal subregions, angular gyrus was characterized by robust and overlapping effects of memory and content. Moreover, subject-specific semantic tuning functions revealed that successful recognition shifted the amplitude of tuning functions in angular gyrus but did not change the selectivity of tuning. In other words, effects of memory and content were additive in angular gyrus. This pattern of data contrasted with occipitotemporal cortex where memory and content effects were interactive: memory effects were preferentially expressed by voxels tuned to the content of a remembered image. Collectively, these findings provide unique insight into how parietal cortex combines information about episodic memory and semantic content.
SIGNIFICANCE STATEMENT Neuroimaging studies of human memory have identified multiple brain regions that not only carry information about “whether” a visual stimulus is successfully recognized but also “what” the content of that stimulus includes. However, a fundamental and open question concerns how the brain integrates these two types of information (memory and content). Here, using a powerful combination of fMRI analysis methods, we show that parietal cortex, particularly the angular gyrus, robustly combines memory- and content-related information, but these two forms of information are represented via additive, independent signals. In contrast, memory effects in high-level visual cortex critically depend on (and interact with) content representations. Together, these findings reveal multiple and distinct ways in which the brain combines memory- and content-related information. -
more » « less
Abstract Exposure to misleading information after witnessing an event can impair future memory reports about the event. This pervasive form of memory distortion, termed the misinformation effect, can be significantly reduced if individuals are warned about the reliability of post-event information before exposure to misleading information. The present fMRI study investigated whether such prewarnings improve subsequent memory accuracy by influencing encoding-related neural activity during exposure to misinformation. We employed a repeated retrieval misinformation paradigm in which participants watched a crime video (Witnessed Event), completed an initial test of memory, listened to a post-event auditory narrative that contained consistent, neutral, and misleading details (Post-Event Information), and then completed a final test of memory. At the behavioral level, participants who were given a prewarning before the Post-Event Information were less susceptible to misinformation on the final memory test compared with participants who were not given a warning (Karanian et al.,
Proceedings of the National Academy of Sciences of the United States of America ,117 , 22771–22779, 2020). This protection from misinformation was accompanied by greater activity in frontal regions associated with source encoding (lateral PFC) and conflict detection (ACC) during misleading trials as well as a more global reduction in activity in auditory cortex and semantic processing regions (left inferior frontal gyrus) across all trials (consistent, neutral, misleading) of the Post-Event Information narrative. Importantly, the strength of these warning-related activity modulations was associated with better protection from misinformation on the final memory test (improved memory accuracy on misleading trials). Together, these results suggest that warnings modulate encoding-related neural activity during exposure to misinformation to improve memory accuracy. -
more » « less
Abstract Previous work shows that automatic attention biases toward recently selected target features transfer across action and perception and even across different effectors such as the eyes and hands on a trial-by-trial basis. Although these findings suggest a common neural representation of selection history across effectors, the extent to which information about recently selected target features is encoded in overlapping versus distinct brain regions is unknown. Using fMRI and a priming of pop-out task where participants selected unpredictable, uniquely colored targets among homogeneous distractors via reach or saccade, we show that color priming is driven by shared, effector-independent underlying representations of recent selection history. Consistent with previous work, we found that the intraparietal sulcus (IPS) was commonly activated on trials where target colors were switched relative to those where the colors were repeated; however, the dorsal anterior insula exhibited effector-specific activation related to color priming. Via multivoxel cross-classification analyses, we further demonstrate that fine-grained patterns of activity in both IPS and the medial temporal lobe encode information about selection history in an effector-independent manner, such that ROI-specific models trained on activity patterns during reach selection could predict whether a color was repeated or switched on the current trial during saccade selection and vice versa. Remarkably, model generalization performance in IPS and medial temporal lobe also tracked individual differences in behavioral priming sensitivity across both types of action. These results represent a first step to clarify the neural substrates of experience-driven selection biases in contexts that require the coordination of multiple actions.
