An official website of the United States government
This study investigates the method for measuring cognitive workload in augmented reality-based biomechanics lectures by analyzing pupil dilation. Using Dikablis Glasses 3 and Microsoft HoloLens, we recorded physiological and subjective data across learning and problem-solving phases. Pupil dilation was normalized and segmented, enabling a comparison of cognitive demands between phases. The results indicated significant correlations between pupil dilation and NASA TLX cognitive demand, particularly in lectures that primarily involved procedural knowledge. These findings suggest that instructional design and content complexity have a significant impact on cognitive load, providing valuable insights for optimizing AR-based learning environments to support cognitive efficiency and student engagement.
more »
« less
Assessing Student Performance Through Pupil Dilation and Problem-Solving Time in Augmented Reality
This research aims to explore the prediction of student learning outcomes in Augmented Reality (AR) educational settings, focusing on engineering education, by analyzing pupil dilation and problem-solving time as key indicators. In this research, we have created an innovative AR learning platform through the incorporation of eye-tracking technology into the Microsoft HoloLens 2. This enhanced learning platform enables the collection of data on pupil dilation and problem-solving duration as students engage in AR-based learning activities. In this study, we hypothesize that pupil dilation and problem-solving time could be significant predictors of student performance in the AR learning environment. The results of our study suggest that problem-solving time may be a critical factor in predicting student learning success for materials involving procedural knowledge at low difficulty levels. Additionally, both pupil dilation and problem-solving time are predictive indicators of student learning outcomes when dealing with predominantly procedural knowledge at high difficulty levels.
more »
« less
- Award ID(s):
- 2202108
- PAR ID:
- 10532958
- Publisher / Repository:
- SAGE Publications
- Date Published:
- Journal Name:
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Volume:
- 68
- Issue:
- 1
- ISSN:
- 1071-1813
- Format(s):
- Medium: X Size: p. 589-595
- Size(s):
- p. 589-595
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
In the digital learning landscape, Augmented Reality (AR) is revolutionizing instructional methodologies. This study shifts focus to explore the impact of AR-based lectures on pupil dilation as a biomarker of mental demand. By analyzing pupil dilation with cognitive load assessment tools like the NASA Task Load Index, we aim to understand the cognitive implications of prolonged exposure to AR in educational settings. We hypothesize that variations in pupil size can be indicative of cognitive load, correlating with the mental demands imposed by AR lectures. Preliminary findings suggest a significant relationship between increased pupil dilation and heightened mental workload during AR engagements. This study highlights a new way to measure cognitive workload in AR environments using pupil dilation data.more » « less
-
Debugging process plays a crucial role in helping students pinpoint their specific learning weaknesses, allowing them to modify their strategies for enhanced academic performance. Notably, changes in pupil dilation serve as an indicator of arousal associated with confronting learning challenges. This physiological response acts as a “physiological footprint” that reflects cognitive engagement, facilitating internally focused cognitive processes such as insight generation and mind-wandering. In this study, we proposed that pupil dilation could be a valuable predictor of students’ metacognitive awareness throughout the debugging process, specifically within an augmented reality (AR) learning environment. The findings revealed significant differences in pupil dilation among students categorized by their varying levels of debugging, which represents a specific dimension of the Metacognitive Awareness Inventory.more » « less
-
Algebra is essential for delving into advanced mathematical topics and STEM courses (Chen, 2013), requiring students to apply various problem-solving strategies to solve algebraic problems (Common Core, 2010). Yet, many students struggle with learning basic algebraic concepts (National Mathematics Advisory Panel (NMAP), 2008). Over the years, both researchers and developers have created a diverse set of educational technology tools and systems to support algebraic learning, especially in facilitating the acquisition of problem- solving strategies and procedural pathways. However, there are very few studies that examine the variable strategies, decisions, and procedural pathways during mathematical problem- solving that may provide further insight into a student’s algebraic knowledge and thinking. Such research has the potential to bolster algebraic knowledge and create a more adaptive and personalized learning environment. This multi-study project explores the effects of various problem-solving strategies on students’ future mathematics performance within the gamified algebraic learning platform From Here to There! (FH2T). Together, these four studies focus on classifying, visualizing, and predicting the procedural pathways students adopted, transitioning from a start state to a goal state in solving algebraic problems. By dissecting the nature of these pathways—optimal, sub-optimal, incomplete, and dead-end—we sought to develop tools and algorithms that could infer strategic thinking that correlated with post-test outcomes. A striking observation across studies was that students who frequently engaged in what we term ‘regular dead-ending behavior’, were more likely to demonstrate higher post-test performance, and conceptual and procedural knowledge. This finding underscores the potential of exploratory learner behavior within a low-stakes gamified framework in bolstering algebraic comprehension. The implications of these findings are twofold: they accentuate the significance of tailoring gamified platforms to student behaviors and highlight the potential benefits of fostering an environment that promotes exploration without retribution. Moreover, these insights hint at the notion that fostering exploratory behavior could be instrumental in cultivating mathematical flexibility. Additionally, the developed tools and findings from the studies, paired with other commonly used student performance metrics and visualizations are used to create a collaborative dashboard–with teachers, for teachers.more » « less
-
Abstract Mastering the concept of distributed forces is vital for students who are pursuing a major involving engineering mechanics. Misconceptions related to distributed forces that are typically acquired in introductory Physics courses should be corrected to increase student success in subsequent mechanics coursework. The goal of this study was to develop and assess a guided instructional activity using augmented reality (AR) technology to improve undergraduate engineering students' understanding of distributed forces. The AR app was accompanied by a complementary activity to guide and challenge students to model objects as beams with progressively increasing difficulty. The AR tool allowed students to (a) model a tabletop as a beam with multiple distributed forces, (b) visualize the free body diagram, and (c) compute the external support reactions. To assess the effectiveness of the activity, 43 students were allocated to control and treatment groups using an experimental nonequivalent groups preactivity/postactivity test design. Of the 43 students, 35 participated in their respective activity. Students in the control group collaborated on traditional problem‐solving, while those in the treatment group engaged in a guided activity using AR. Students' knowledge of distributed forces was measured using their scores on a 10‐item test instrument. Analysis of covariance was utilized to analyze postactivity test scores by controlling for the preactivity test scores. The treatment group demonstrated a significantly greater improvement in postactivity test scores than that of the control group. The measured effect size was 0.13, indicating that 13% of the total variance in the postactivity test scores can be attributed to the activity. Though the effect size was small, the results suggest that a guided AR activity can be more effective in improving student learning outcomes than traditional problem‐solving.more » « less
