An official website of the United States government
Abstract The research presented in this paper investigated the changes that occur in the prefrontal cortex (PFC) when new ideas are introduced during engineering design. Undergraduate and graduate engineering students (n = 25) were outfitted with a functional near-infrared spectroscopy (fNIRS) headband. Students were asked to design a personal entertainment system while thinking aloud. New ideas were timestamped with the fNIRS data across 48 channels grouped into eight regions within the PFC. The data were preprocessed using temporal derivative distribution repair motion correction, finite impulse response bandpass filter, and the modified beer-lambert law to convert optical density into hemoglobin concentration. Baseline neurocognitive activation and physiological noise were removed. The study found a significant decrease in oxygenated hemoglobin in the left dorsolateral prefrontal cortex and a subregion of the left ventrolateral prefrontal cortex when new ideas were introduced during design. This finding begins to provide a neurocognitive signature of what a new idea looks like as it arises in the brain. This could be used to develop tools and techniques to inhibit this brain region or use this insight to predict when designers will experience a new idea based on their neural activation.
more »
« less
Cognitive Engagement for STEM+C Education: Investigating Serious Game Impact on Graph Structure Learning with fNIRS
For serious games on education, understanding the effectiveness of different learning methods in influencing cognitive processes remains a significant challenge. In particular, limited research addresses the comparative effectiveness of serious games and videos in analyzing brain behavior for graph structure learning, which is an important part of the Science, Technology, Engineering, Math, and Computing (STEM+C) disciplinary education. This study investigates the impact of serious games on graph structure learning. For this, we compared our in-house game-based learning (GBL) and video-based learning (VBL) methodologies by evaluating their effectiveness on cognitive processes by oxygenated hemoglobin levels using functional near-infrared spectroscopy (fNIRS). We conducted a 2×1 between-subjects preliminary study with twelve participants, involving two conditions: game and video. Both groups received equivalent content related to the basic structure of a graph, with comparable session lengths. The game group interacted with a quiz-based game, while the video group watched a pre-recorded video. The fNIRS was employed to capture cerebral signals from the prefrontal cortex, and participants completed pre- and post-questionnaires capturing user experience and knowledge gain. In our study, we noted that the mean levels of oxygenated hemoglobin (delta HbO) were higher in the GBL group, suggesting the potential enhanced cognitive involvement. Our results show that the lateral prefrontal cortex (LPFC) has greater hemodynamic activity during the learning period. Moreover, knowledge gain analysis showed an increase in mean score in the GBL group compared to the VBL group. Although we did not observe statistically significant changes due to participant variability and sample size, this preliminary work contributes to understanding how GBL and VBL impact cognitive processes, providing insights for enhanced instructional design and educational game development. Additionally, it emphasizes the necessity for further investigation into the impact of GBL on cognitive engagement and learning outcomes.
more »
« less
- PAR ID:
- 10555507
- Publisher / Repository:
- IEEE
- Date Published:
- Journal Name:
- IEEE International Conference on Artificial Intelligence and Virtual Reality
- ISSN:
- 2771-7453
- ISBN:
- 979-8-3503-7202-1
- Page Range / eLocation ID:
- 195 to 204
- Subject(s) / Keyword(s):
- Cognitive processes Education Games User experience Hemodynamics Functional near-infrared spectroscopy Videos serious game game-based learning video-based learning brain activity fNIRS hemodynamic response oxygenated and deoxygenated hemoglobin
- Format(s):
- Medium: X
- Location:
- Los Angeles, CA, USA
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Game-based learning (GBL) has increasingly been used to promote students’ learning engagement. Although prior GBL studies have highlighted the significance of learning engagement as a mediator of students’ meaningful learning, the existing accounts failed to capture specific evidence of how exactly students’ in-game actions in GBL enhance learning engagement. Hence, this mixed-method study was designed to examine whether middle school students’ in-game actions are likely to promote certain types of learning engagement (i.e., content and cognitive engagement). This study used and examined the game E-Rebuild, a single-player three-dimensional architecture game that requires learners’ application of math knowledge. Using in-depth gameplay behavior analysis, this study sampled a total of 92 screen-recorded and video-captured gameplay sessions attended by 25 middle school students. We adopted two analytic approaches: sequential analysis and thematic analysis. Whereas sequential analysis explored which in-game actions by students were likely to promote each type of learning engagement, the thematic analysis depicted how certain gameplay contexts contributed to students’ enhanced learning engagement. The study found that refugee allocation and material trading actions promoted students’ content engagement, whereas using in-game building tools and learning support boosted their cognitive engagement. This study also found that students’ learning engagement was associated with their development of mathematical thinking in a GBL context.more » « less
-
The quest to incorporate digital games into US classrooms has been pervasive in educational communities over the last two decades. Educational video games have been studied as a mechanism for enhancing the engagement and performance of underrepresented groups (UGs) in spatial learning, physics, computer science, general engineering, software and electrical engineering, mechanical engineering (ME) computer aided design, and aerospace engineering. Less than a handful of these studies have explored games’ appeal, efficacy or UG performance as a function of gender. Preliminary findings on a study that explores the appeal, efficacy, and performance of UGs in engineering-based educational video games as a function of gender and those of intersectional backgrounds is discussed. Emphasis is placed on elucidating these students' perceptions of serious game structure, design and content, and how these factors motivate their learning of engineering concepts and self-identification as engineers. This work builds upon the Technology Acceptance Model.more » « less
-
Functional near infrared spectroscopy (fNIR) is a noninvasive, portable optical imaging tool to monitor changes in hemodynamic responses (i.e., oxygenated hemoglobin (HbO)) within the prefrontal cortex (PFC) in response to sensory, motor or cognitive activation. We used fNIR for monitoring PFC activation during learning of simulated laparoscopic surgical tasks throughout 4 days of training and testing. Blocked (BLK) and random (RND) practice orders were used to test the practice schedule effect on behavioral, hemodynamic responses and relative neural efficiency (EFFrel-neural) measures during transfer. Left and right PFC for both tasks showed significant differences with RND using less HbO than BLK. Cognitive workload showed RND exhibiting high EFFrel-neural across the PFC for the coordination task while the more difficult cholecystectomy task showed EFFrel-neural differences only in the left PFC. Use of brain activation, behavioral and EFFrel-neural measures can provide a more accurate depiction of the generalization or transfer of learning.more » « less
-
Abstract Objective. Spontaneous fluctuations of cerebral hemodynamics measured by functional magnetic resonance imaging (fMRI) are widely used to study the network organization of the brain. The temporal correlations among the ultra-slow, <0.1 Hz fluctuations across the brain regions are interpreted as functional connectivity maps and used for diagnostics of neurological disorders. However, despite the interest narrowed in the ultra-slow fluctuations, hemodynamic activity that exists beyond the ultra-slow frequency range could contribute to the functional connectivity, which remains unclear.Approach. In the present study, we have measured the brain-wide hemodynamics in the human participants with functional near-infrared spectroscopy (fNIRS) in a whole-head, cap-based and high-density montage at a sampling rate of 6.25 Hz. In addition, we have acquired resting state fMRI scans in the same group of participants for cross-modal evaluation of the connectivity maps. Then fNIRS data were deliberately down-sampled to a typical fMRI sampling rate of ∼0.5 Hz and the resulted differential connectivity maps were subject to a k-means clustering.Main results. Our diffuse optical topographical analysis of fNIRS data have revealed a default mode network (DMN) in the spontaneous deoxygenated and oxygenated hemoglobin changes, which remarkably resemble the same fMRI network derived from participants. Moreover, we have shown that the aliased activities in the down-sampled optical signals have altered the connectivity patterns, resulting in a network organization of aliased functional connectivity in the cerebral hemodynamics.Significance.The results have for the first time demonstrated that fNIRS as a broadly accessible modality can image the resting-state functional connectivity in the posterior midline, prefrontal and parietal structures of the DMN in the human brain, in a consistent pattern with fMRI. Further empowered by the fast sampling rate of fNIRS, our findings suggest the presence of aliased connectivity in the current understanding of the human brain organization.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1109/AIxVR59861.2024.00032
