An official website of the United States government
Researchers have been employing psycho-physiological measures to better understand program comprehension, for example simultaneous fMRI and eye tracking to validate top-down comprehension models. In this paper, we argue that there is additional value in eye-tracking data beyond eye gaze: Pupil dilation and blink rates may offer insights into programmers' cognitive load. However, the fMRI environment may influence pupil dilation and blink rates, which would diminish their informative value. We conducted a preliminary analysis of pupil dilation and blink rates of an fMRI experiment with 22 student participants. We conclude from our preliminary analysis that the correction for our fMRI environment is challenging, but possible, such that we can use pupil dilation and blink rates to more reliably observe program comprehension.
more »
« less
Application of NeuroIS Tools to Understand Cognitive Behaviors of Student Learners in Biochemistry
Cognitive load has received increased focus as an area that can be more richly explored using neuroIS tools. This research study presents the application of electroencephalography and eye tracking technologies to examine cognitive load of student learners in biochemistry. In addition to leveraging the Pope Engagement Index and eye tracking analysis techniques, we seek better understanding of the relationship that various individual characteristics have with the level of cognitive load experienced. While this study focuses on a particular STEM student population as they manipulate various learning models, it has implications for further studies in human-computer interaction and other learning environments.
more »
« less
- Award ID(s):
- 1711425
- PAR ID:
- 10108360
- Date Published:
- Journal Name:
- Proceedings NeuroIS Retreat 2019
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Cognitive processes have been found to contribute substantially to the human errors that lead to construction accidents. Working memory—a cognitive system with a limited capacity that is responsible for temporarily holding information available for processing—plays an important role in reasoning and decision-making. Since eye movements indicate where a worker directs his/her attention, tracking such movements provides a practical way to measure workers’ attention and comprehension of construction hazards. As a departure in construction industry research, this study correlates attentional allocation with working memory to assess workers’ situation awareness under different scenarios that expose workers to various hazards. To achieve this goal, this study merges research linking eye movements and workers’ attention with research focused on working-memory load and decision making and evaluates what, how, and where a worker distributes his/her attention while performing a task under different working-memory loads. Path analysis models then examined the direct and indirect effect of different working-memory loads on hazard identification performance. The independent variable (working-memory load) is linked to the dependent variable (hazard identification) through the set of mediators (attention metrics). The results showed that the high-memory load condition delayed workers’ hazard identification. The findings of this study emphasize the important role working memory plays in determining how and why workers in dynamic work environments fail to detect, comprehend, and/or respond to physical risks.more » « less
-
A large portion of the cost of any software lies in the time spent by developers in understanding a program’s source code before any changes can be undertaken. Measuring program comprehension is not a trivial task. In fact, different studies use self-reported and various psycho-physiological measures as proxies. In this research, we propose a methodology using functional Near Infrared Spectroscopy (fNIRS) and eye tracking devices as an objective measure of program comprehension that allows researchers to conduct studies in environments close to real world settings, at identifier level of granularity. We validate our methodology and apply it to study the impact of lexical, structural, and readability issues on developers’ cognitive load during bug localization tasks. Our study involves 25 undergraduate and graduate students and 21 metrics. Results show that the existence of lexical inconsistencies in the source code significantly increases the cognitive load experienced by participants not only on identifiers involved in the inconsistencies but also throughout the entire code snippet. We did not find statistical evidence that structural inconsistencies increase the average cognitive load that participants experience, however, both types of inconsistencies result in lower performance in terms of time and success rate. Finally, we observe that self-reported task difficulty, cognitive load, and fixation duration do not correlate and appear to be measuring different aspects of task difficulty.more » « less
-
null (Ed.)Automated tracking of physical fitness has sparked a health revolution by allowing individuals to track their own physical activity and health in real time. This concept is beginning to be applied to tracking of cognitive load. It is well known that activity in the brain can be measured through changes in the body’s physiology, but current real-time measures tend to be unimodal and invasive. We therefore propose the concept of a wearable educational fitness (EduFit) tracker. We use machine learning with physiological data to understand how to develop a wearable device that tracks cognitive load accurately in real time. In an initial study, we found that body temperature, skin conductance, and heart rate were able to distinguish between (i) a problem solving activity (high cognitive load), (ii) a leisure activity (moderate cognitive load), and (iii) daydreaming (low cognitive load) with high accuracy in the test dataset. In a second study, we found that these physiological features can be used to predict accurately user-reported mental focus in the test dataset, even when relatively small numbers of training data were used. We explain how these findings inform the development and implementation of a wearable device for temporal tracking and logging a user’s learning activities and cognitive load.more » « less
-
In this digital learning era, Augmented Reality (AR) has become a significant driver of innovative user experience. However, the ergonomic implications of AR, particularly regarding the postural fatigue dynamics, have not been comprehensively addressed. This study investigates the correlation between prolonged AR engagement and the onset of postural fatigue, characterized by a backward shift in the center of mass (COM). Employing motion capture technology alongside cognitive load assessment tools such as the NASA Task Load Index and HoloLens eye-tracking, we seek to quantify the relationship between user posture, engagement duration, and perceived workload. We hypothesize that an observable rearward displacement of COM signifies escalating fatigue levels. The methodology integrates ergonomic analysis, biomechanics, and predictive modeling. Preliminary findings indicate a decline in postural stability with increased AR exposure, reinforcing the need for ergonomics interventions. This study underscores the necessity of ergonomic consideration in the design and use of AR systems to safeguard user well-being in educational settings.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
