An official website of the United States government
In the digital learning landscape, Augmented Reality (AR) is revolutionizing instructional methodologies. This study shifts focus to explore the impact of AR-based lectures on pupil dilation as a biomarker of mental demand. By analyzing pupil dilation with cognitive load assessment tools like the NASA Task Load Index, we aim to understand the cognitive implications of prolonged exposure to AR in educational settings. We hypothesize that variations in pupil size can be indicative of cognitive load, correlating with the mental demands imposed by AR lectures. Preliminary findings suggest a significant relationship between increased pupil dilation and heightened mental workload during AR engagements. This study highlights a new way to measure cognitive workload in AR environments using pupil dilation data.
more »
« less
This content will become publicly available on July 15, 2026
Measuring Mental Demand Using Pupil Dilation in an Augmented Reality Environment
This study investigates the method for measuring cognitive workload in augmented reality-based biomechanics lectures by analyzing pupil dilation. Using Dikablis Glasses 3 and Microsoft HoloLens, we recorded physiological and subjective data across learning and problem-solving phases. Pupil dilation was normalized and segmented, enabling a comparison of cognitive demands between phases. The results indicated significant correlations between pupil dilation and NASA TLX cognitive demand, particularly in lectures that primarily involved procedural knowledge. These findings suggest that instructional design and content complexity have a significant impact on cognitive load, providing valuable insights for optimizing AR-based learning environments to support cognitive efficiency and student engagement.
more »
« less
- Award ID(s):
- 2202108
- PAR ID:
- 10643894
- Publisher / Repository:
- Sage Journals
- Date Published:
- Journal Name:
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- ISSN:
- 1071-1813
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Debugging process plays a crucial role in helping students pinpoint their specific learning weaknesses, allowing them to modify their strategies for enhanced academic performance. Notably, changes in pupil dilation serve as an indicator of arousal associated with confronting learning challenges. This physiological response acts as a “physiological footprint” that reflects cognitive engagement, facilitating internally focused cognitive processes such as insight generation and mind-wandering. In this study, we proposed that pupil dilation could be a valuable predictor of students’ metacognitive awareness throughout the debugging process, specifically within an augmented reality (AR) learning environment. The findings revealed significant differences in pupil dilation among students categorized by their varying levels of debugging, which represents a specific dimension of the Metacognitive Awareness Inventory.more » « less
-
This research aims to explore the prediction of student learning outcomes in Augmented Reality (AR) educational settings, focusing on engineering education, by analyzing pupil dilation and problem-solving time as key indicators. In this research, we have created an innovative AR learning platform through the incorporation of eye-tracking technology into the Microsoft HoloLens 2. This enhanced learning platform enables the collection of data on pupil dilation and problem-solving duration as students engage in AR-based learning activities. In this study, we hypothesize that pupil dilation and problem-solving time could be significant predictors of student performance in the AR learning environment. The results of our study suggest that problem-solving time may be a critical factor in predicting student learning success for materials involving procedural knowledge at low difficulty levels. Additionally, both pupil dilation and problem-solving time are predictive indicators of student learning outcomes when dealing with predominantly procedural knowledge at high difficulty levels.more » « less
-
Researchers have been employing psycho-physiological measures to better understand program comprehension, for example simultaneous fMRI and eye tracking to validate top-down comprehension models. In this paper, we argue that there is additional value in eye-tracking data beyond eye gaze: Pupil dilation and blink rates may offer insights into programmers' cognitive load. However, the fMRI environment may influence pupil dilation and blink rates, which would diminish their informative value. We conducted a preliminary analysis of pupil dilation and blink rates of an fMRI experiment with 22 student participants. We conclude from our preliminary analysis that the correction for our fMRI environment is challenging, but possible, such that we can use pupil dilation and blink rates to more reliably observe program comprehension.more » « less
-
This paper demonstrates the utility of ambient-focal attention and pupil dilation dynamics to describe visual processing of emotional facial expressions. Pupil dilation and focal eye movements reflect deeper cognitive processing and thus shed more light on the dy- namics of emotional expression recognition. Socially anxious in- dividuals (N = 24) and non-anxious controls (N = 24) were asked to recognize emotional facial expressions that gradually morphed from a neutral expression to one of happiness, sadness, or anger in 10-sec animations. Anxious cohorts exhibited more ambient face scanning than their non-anxious counterparts. We observed a positive relationship between focal fixations and pupil dilation, indi- cating deeper processing of viewed faces, but only by non-anxious participants, and only during the last phase of emotion recognition. Group differences in the dynamics of ambient-focal attention sup- port the hypothesis of vigilance to emotional expression processing by socially anxious individuals. We discuss the results by referring to current literature on cognitive psychopathology.more » « less
