skip to main content


Title: Enhancing learning and retention with distinctive virtual reality environments and mental context reinstatement
Abstract

Memory is inherently context-dependent: internal and environmental cues become bound to learnt information, and the later absence of these cues can impair recall. Here, we developed an approach to leverage context-dependence to optimise learning of challenging, interference-prone material. While navigating through desktop virtual reality (VR) contexts, participants learnt 80 foreign words in two phonetically similar languages. Those participants who learnt each language in its own unique context showed reduced interference and improved one-week retention (92%), relative to those who learnt the languages in the same context (76%)—however, this advantage was only apparent if participants subjectively experienced VR-based contexts as “real” environments. A follow-up fMRI experiment confirmed that reinstatement of brain activity patterns associated with the original encoding context during word retrieval was associated with improved recall performance. These findings establish that context-dependence can be harnessed with VR to optimise learning and showcase the important role of mental context reinstatement.

 
more » « less
NSF-PAR ID:
10384698
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
npj Science of Learning
Volume:
7
Issue:
1
ISSN:
2056-7936
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    While semantic and episodic memory have been shown to influence each other, uncertainty remains as to how this interplay occurs. We introduce a behavioral representational similarity analysis approach to assess whether semantic space can be subtly re-sculpted by episodic learning. Eighty participants learned word pairs that varied in semantic relatedness, and learning was bolstered via either testing or restudying. Next-day recall is superior for semantically related pairs, but there is a larger benefit of testing for unrelated pairs. Analyses of representational change reveal that successful recall is accompanied by a pulling together of paired associates, with cue words in semantically related (but not unrelated) pairs changing more across learning than target words. Our findings show that episodic learning is associated with systematic and asymmetrical distortions of semantic space which improve later recall by making cues more predictive of targets, reducing interference from potential lures, and establishing novel connections within pairs.

     
    more » « less
  2. Abstract

    Autism spectrum disorder (ASD) is associated with episodic memory impairment. However, episodic memories include a variety of contextual details, and it is difficult to solely rely on behavioral data to assess how specifically (i.e. event-specific reinstatement) an event is remembered. We applied encoding-retrieval representational similarity (ERS) analysis to EEG data to assess event-specific ERS for object-context associations in a sample of 34 adults (17 with, 17 without ASD). Participants studied objects presented alongside 2 contextual features: scene/color, and attention was directed toward one object-context relationship. At retrieval, memory was assessed for the object and both contexts. Behavioral results revealed no group differences in item or context memory performance. ERS results revealed group temporal differences in reinstatement. Results may indicate differences in both encoding (i.e. fewer perceptual details) and retrieval (i.e. ineffectively skipping through memory fragments) in ASD and should be further investigated in studies modulating the perceptual detail required for memory decisions. Results highlight the utility of ERS as a methodology used to evaluate episodic reinstatement even in the absence of behavioral differences in memory performance.

     
    more » « less
  3. Abstract

    Face memory, including the ability to recall a person’s name, is of major importance in social contexts. Like many other memory functions, it may rely on sleep. We investigated whether targeted memory reactivation during sleep could improve associative and perceptual aspects of face memory. Participants studied 80 face-name pairs, and then a subset of spoken names with associated background music was presented unobtrusively during a daytime nap. This manipulation preferentially improved name recall and face recognition for those reactivated face-name pairs, as modulated by two factors related to sleep quality; memory benefits were positively correlated with the duration of stage N3 sleep (slow-wave sleep) and negatively correlated with measures of sleep disruption. We conclude that (a) reactivation of specific face-name memories during sleep can strengthen these associations and the constituent memories, and that (b) the effectiveness of this reactivation depends on uninterrupted N3 sleep.

     
    more » « less
  4. Abstract

    Language processing is cognitively demanding, requiring attentional resources to efficiently select and extract linguistic information as utterances unfold. Previous research has associated changes in pupil size with increased attentional effort. However, it is unknown whether the behavioral ecology of speakers may differentially affect engagement of attentional resources involved in conversation. For bilinguals, such an act potentially involves competing signals in more than one language and how this competition arises may differ across communicative contexts. We examined changes in pupil size during the comprehension of unilingual and codeswitched speech in a richly-characterized bilingual sample. In a visual-world task, participants saw pairs of objects as they heard instructions to select a target image. Instructions were either unilingual or codeswitched from one language to the other. We found that only bilinguals who use each of their languages in separate communicative contexts and who have high attention ability, show differential attention to unilingual and codeswitched speech. Bilinguals for whom codeswitching is common practice process unilingual and codeswitched speech similarly, regardless of attentional skill. Taken together, these results suggest that bilinguals recruit different language control strategies for distinct communicative purposes. The interactional context of language use critically determines attentional control engagement during language processing.

     
    more » « less
  5. Abstract

    People may experience emotions before interacting with automated agents to seek information and support. However, existing literature has not well examined how human emotional states affect their interaction experience with agents or how automated agents should react to emotions. This study proposes to test how participants perceive an empathetic agent (chatbot) vs. a non-empathetic one under various emotional states (i.e., positive, neutral, negative) when the chatbot mediates the initial screening process for student advising. Participants are prompted to recall a previous emotional experience and have text-based conversations with the chatbot. The study confirms the importance of presenting empathetic cues in the design of automated agents to support human-agent collaboration. Participants who recall a positive experience are more sensitive to the chatbot’s empathetic behavior. The empathetic behavior of the chatbot improves participants’ satisfaction and makes those who recall a neutral experience feel more positive during the interaction. The results reveal that participants’ emotional states are likely to influence their tendency to self-disclose, interaction experience, and perception of the chatbot’s empathetic behavior. The study also highlights the increasing need for emotional acknowledgment of people who experience positive emotions so that design efforts need to be designated according to people’s dynamic emotional states.

     
    more » « less