This study investigates the method for measuring cognitive workload in augmented reality-based biomechanics lectures by analyzing pupil dilation. Using Dikablis Glasses 3 and Microsoft HoloLens, we recorded physiological and subjective data across learning and problem-solving phases. Pupil dilation was normalized and segmented, enabling a comparison of cognitive demands between phases. The results indicated significant correlations between pupil dilation and NASA TLX cognitive demand, particularly in lectures that primarily involved procedural knowledge. These findings suggest that instructional design and content complexity have a significant impact on cognitive load, providing valuable insights for optimizing AR-based learning environments to support cognitive efficiency and student engagement.
more »
« less
Measuring Cognitive Workload in Augmented Reality Learning Environments Through Pupil Area Analysis
In the digital learning landscape, Augmented Reality (AR) is revolutionizing instructional methodologies. This study shifts focus to explore the impact of AR-based lectures on pupil dilation as a biomarker of mental demand. By analyzing pupil dilation with cognitive load assessment tools like the NASA Task Load Index, we aim to understand the cognitive implications of prolonged exposure to AR in educational settings. We hypothesize that variations in pupil size can be indicative of cognitive load, correlating with the mental demands imposed by AR lectures. Preliminary findings suggest a significant relationship between increased pupil dilation and heightened mental workload during AR engagements. This study highlights a new way to measure cognitive workload in AR environments using pupil dilation data.
more »
« less
- Award ID(s):
- 2202108
- PAR ID:
- 10643769
- Publisher / Repository:
- Springer Nature Switzerland
- Date Published:
- ISBN:
- 978-3-031-61569-6
- Page Range / eLocation ID:
- 167 to 181
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Debugging process plays a crucial role in helping students pinpoint their specific learning weaknesses, allowing them to modify their strategies for enhanced academic performance. Notably, changes in pupil dilation serve as an indicator of arousal associated with confronting learning challenges. This physiological response acts as a “physiological footprint” that reflects cognitive engagement, facilitating internally focused cognitive processes such as insight generation and mind-wandering. In this study, we proposed that pupil dilation could be a valuable predictor of students’ metacognitive awareness throughout the debugging process, specifically within an augmented reality (AR) learning environment. The findings revealed significant differences in pupil dilation among students categorized by their varying levels of debugging, which represents a specific dimension of the Metacognitive Awareness Inventory.more » « less
-
This research aims to explore the prediction of student learning outcomes in Augmented Reality (AR) educational settings, focusing on engineering education, by analyzing pupil dilation and problem-solving time as key indicators. In this research, we have created an innovative AR learning platform through the incorporation of eye-tracking technology into the Microsoft HoloLens 2. This enhanced learning platform enables the collection of data on pupil dilation and problem-solving duration as students engage in AR-based learning activities. In this study, we hypothesize that pupil dilation and problem-solving time could be significant predictors of student performance in the AR learning environment. The results of our study suggest that problem-solving time may be a critical factor in predicting student learning success for materials involving procedural knowledge at low difficulty levels. Additionally, both pupil dilation and problem-solving time are predictive indicators of student learning outcomes when dealing with predominantly procedural knowledge at high difficulty levels.more » « less
-
Researchers have been employing psycho-physiological measures to better understand program comprehension, for example simultaneous fMRI and eye tracking to validate top-down comprehension models. In this paper, we argue that there is additional value in eye-tracking data beyond eye gaze: Pupil dilation and blink rates may offer insights into programmers' cognitive load. However, the fMRI environment may influence pupil dilation and blink rates, which would diminish their informative value. We conducted a preliminary analysis of pupil dilation and blink rates of an fMRI experiment with 22 student participants. We conclude from our preliminary analysis that the correction for our fMRI environment is challenging, but possible, such that we can use pupil dilation and blink rates to more reliably observe program comprehension.more » « less
-
The mental demands associated with operating complex whole-body powered exoskeletons are poorly understood. This study aimed to explore the overall workload associated with using a powered wholebody exoskeleton among expert and novice users, as well as the changes in workload resulting from novices adapting to exoskeleton-use over time. We used eye-tracking measures to quantify the differences in workload of six novices and five experts while they performed a levelwalking task, with and without wearing a whole-body powered exoskeleton. We found that only novices’ pupil dilation (PD) increased, while experts showed a greater proportion of downward-directed pathfixations (PF) compared to novices while wearing the exoskeleton. These results indicate that novices’ mental demands were higher, and that experts and novices exhibited distinct visuomotor strategies. Eyetracking measures may potentially be used to detect differences in workload and skill-level associated with using exoskeletons, and also considered as inputs for future adaptive exoskeleton control algorithms.more » « less
An official website of the United States government

