skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Modeling Brain Dynamics During Virtual Reality-Based Emergency Response Learning Under Stress
Background Stress affects learning during training, and virtual reality (VR) based training systems that manipulate stress can improve retention and retrieval performance for firefighters. Brain imaging using functional Near Infrared Spectroscopy (fNIRS) can facilitate development of VR-based adaptive training systems that can continuously assess the trainee’s states of learning and cognition. Objective The aim of this study was to model the neural dynamics associated with learning and retrieval under stress in a VR-based emergency response training exercise. Methods Forty firefighters underwent an emergency shutdown training in VR and were randomly assigned to either a control or a stress group. The stress group experienced stressors including smoke, fire, and explosions during the familiarization and training phase. Both groups underwent a stress memory retrieval and no-stress memory retrieval condition. Participant’s performance scores, fNIRS-based neural activity, and functional connectivity between the prefrontal cortex (PFC) and motor regions were obtained for the training and retrieval phases. Results The performance scores indicate that the rate of learning was slower in the stress group compared to the control group, but both groups performed similarly during each retrieval condition. Compared to the control group, the stress group exhibited suppressed PFC activation. However, they showed stronger connectivity within the PFC regions during the training and between PFC and motor regions during the retrieval phases. Discussion While stress impaired performance during training, adoption of stress-adaptive neural strategies (i.e., stronger brain connectivity) were associated with comparable performance between the stress and the control groups during the retrieval phase.  more » « less
Award ID(s):
2033592
PAR ID:
10422286
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Human Factors: The Journal of the Human Factors and Ergonomics Society
ISSN:
0018-7208
Page Range / eLocation ID:
001872082110548
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; (, Brain Sciences)
    null (Ed.)
    The nature of firefighters’ duties requires them to work for long periods under unfavorable conditions. To perform their jobs effectively, they are required to endure long hours of extensive, stressful training. Creating such training environments is very expensive and it is difficult to guarantee trainees’ safety. In this study, firefighters are trained in a virtual environment that includes virtual perturbations such as fires, alarms, and smoke. The objective of this paper is to use machine learning methods to discern encoding and retrieval states in firefighters during a visuospatial episodic memory task and explore which regions of the brain provide suitable signals to solve this classification problem. Our results show that the Random Forest algorithm could be used to distinguish between information encoding and retrieval using features extracted from fNIRS data. Our algorithm achieved an F-1 score of 0.844 and an accuracy of 79.10% if the training and testing data are obtained at similar environmental conditions. However, the algorithm’s performance dropped to an F-1 score of 0.723 and accuracy of 60.61% when evaluated on data collected under different environmental conditions than the training data. We also found that if the training and evaluation data were recorded under the same environmental conditions, the RPM, LDLPFC, RDLPFC were the most relevant brain regions under non-stressful, stressful, and a mix of stressful and non-stressful conditions, respectively. 
    more » « less
  2. ; ; ; ; (, Frontiers in Human Neuroscience)
    IntroductionAs robot teleoperation increasingly becomes integral in executing tasks in distant, hazardous, or inaccessible environments, operational delays remain a significant obstacle. These delays, inherent in signal transmission and processing, adversely affect operator performance, particularly in tasks requiring precision and timeliness. While current research has made strides in mitigating these delays through advanced control strategies and training methods, a crucial gap persists in understanding the neurofunctional impacts of these delays and the efficacy of countermeasures from a cognitive perspective. MethodsThis study addresses the gap by leveraging functional Near-Infrared Spectroscopy (fNIRS) to examine the neurofunctional implications of simulated haptic feedback on cognitive activity and motor coordination under delayed conditions. In a human-subject experiment (N= 41), sensory feedback was manipulated to observe its influences on various brain regions of interest (ROIs) during teleoperation tasks. The fNIRS data provided a detailed assessment of cerebral activity, particularly in ROIs implicated in time perception and the execution of precise movements. ResultsOur results reveal that the anchoring condition, which provided immediate simulated haptic feedback with a delayed visual cue, significantly optimized neural functions related to time perception and motor coordination. This condition also improved motor performance compared to the asynchronous condition, where visual and haptic feedback were misaligned. DiscussionThese findings provide empirical evidence about the neurofunctional basis of the enhanced motor performance with simulated synthetic force feedback in the presence of teleoperation delays. The study highlights the potential for immediate haptic feedback to mitigate the adverse effects of operational delays, thereby improving the efficacy of teleoperation in critical applications. 
    more » « less
  3. (, Lecture Notes in Computer Science)
    Functional near infrared spectroscopy (fNIR) is a noninvasive, portable optical imaging tool to monitor changes in hemodynamic responses (i.e., oxygenated hemoglobin (HbO)) within the prefrontal cortex (PFC) in response to sensory, motor or cognitive activation. We used fNIR for monitoring PFC activation during learning of simulated laparoscopic surgical tasks throughout 4 days of training and testing. Blocked (BLK) and random (RND) practice orders were used to test the practice schedule effect on behavioral, hemodynamic responses and relative neural efficiency (EFFrel-neural) measures during transfer. Left and right PFC for both tasks showed significant differences with RND using less HbO than BLK. Cognitive workload showed RND exhibiting high EFFrel-neural across the PFC for the coordination task while the more difficult cholecystectomy task showed EFFrel-neural differences only in the left PFC. Use of brain activation, behavioral and EFFrel-neural measures can provide a more accurate depiction of the generalization or transfer of learning. 
    more » « less
  4. ; (, Proc. of 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI))
    This paper describes a group-level analysis of 14 subjects with prefrontal cortex (pFC) lesions and 20 healthy controls performing multiple lateralized visuospatial working memory (WM) trials. Using effective brain connectivity measures inferred from directed information (DI) during memory encoding, we first show that DI features can correctly classify 18 control subjects and 11 subjects with pFC lesions, providing an overall accuracy of 85.3%. Second, we show that differential DI, the change in DI during the encoding phase from pretrial, can successfully overcome inter-subject variability and correctly identify the class of all 34 subjects (100% accuracy). These accuracy results are based on two-thirds majority thresholding among all trials. Finally, we use Welch’s t-test to identify the crucial differences in the two classes’ sub-networks responsible for memory encoding. While the inflow of information to the prefrontal region is significant among subjects with pFC lesions, the outflow from the prefrontal to the frontal and central regions is diminished compared to the control subjects. We further identify specific neural pathways that are exclusively activated for each group during the encoding phase. 
    more » « less
  5. ; ; (, ASME 2023 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference)
    Abstract The research presented in this paper investigated the changes that occur in the prefrontal cortex (PFC) when new ideas are introduced during engineering design. Undergraduate and graduate engineering students (n = 25) were outfitted with a functional near-infrared spectroscopy (fNIRS) headband. Students were asked to design a personal entertainment system while thinking aloud. New ideas were timestamped with the fNIRS data across 48 channels grouped into eight regions within the PFC. The data were preprocessed using temporal derivative distribution repair motion correction, finite impulse response bandpass filter, and the modified beer-lambert law to convert optical density into hemoglobin concentration. Baseline neurocognitive activation and physiological noise were removed. The study found a significant decrease in oxygenated hemoglobin in the left dorsolateral prefrontal cortex and a subregion of the left ventrolateral prefrontal cortex when new ideas were introduced during design. This finding begins to provide a neurocognitive signature of what a new idea looks like as it arises in the brain. This could be used to develop tools and techniques to inhibit this brain region or use this insight to predict when designers will experience a new idea based on their neural activation. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email