This study aims to develop an interactive learning solution for engineering education by combining augmented reality (AR), Near-Field Electromagnetic Ranging (NFER), and motion capture technologies. We built an instructional system that integrates AR devices and real-time positioning sensors to improve the interactive experience of learners in an immersive learning environment, while the motion, eye-tracking, and location-tracking data collected by the devices applied to learners enable instructors to understand their learning patterns. To test the usability of the system, two AR-based lectures were developed with different difficulty levels (Lecture 1 - Easy vs. Lecture 2 - Hard), and the System Usability Scale (SUS) was collected from thirty participants. We did not observe a significant usability difference between Lecture 1 and Lecture 2. Through the experiment, we demonstrated the robustness of this AR learning system and its unique promise in integrating AR teaching with other technologies.
more »
« less
This content will become publicly available on August 13, 2025
Utilizing Motion Capture to Quantify Physical Workload in Augmented Reality Learning Environments
This study examines the ergonomic impact of augmented reality (AR) technologies in educational contexts, with a focus on understanding how prolonged AR engagement affects postural dynamics and physical demands on users. By analyzing slouching scores alongside NASA Task Load Index (TLX) Physical Demand (PD) values, we assess the physical strain experienced by participants during the initial modules of an AR-based lecture series. Our findings demonstrate a notable decline in slouching scores as participants progress through the lecture modules, indicating increased postural deviations. To quantify these effects, we developed a regression model that effectively predicts the physical demands imposed by various AR modules, based on the observed slouching scores.
more » « less- PAR ID:
- 10532880
- Publisher / Repository:
- SAGE Publications
- Date Published:
- Journal Name:
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Volume:
- 68
- Issue:
- 1
- ISSN:
- 1071-1813
- Format(s):
- Medium: X Size: p. 1181-1187
- Size(s):
- p. 1181-1187
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Current lower-limb prostheses do not provide active assistance in postural control tasks to maintain the user’s balance, particularly in situations of perturbation. In this study, we aimed to address this missing function by enabling neural control of robotic lower-limb prostheses. Specifically, electromyographic (EMG) signals (amplified neural control signals) recorded from antagonistic residual ankle muscles were used to drive a robotic prosthetic ankle directly and continuously. Participants with transtibial amputation were recruited and trained in using the EMG-driven robotic ankle. We studied how using the EMG-controlled ankle affected the participants’ anticipatory and compensatory postural control strategies and stability under expected perturbations compared with using their daily passive devices. We investigated the similarity of neuromuscular coordination (by analyzing motor modules) of the participants, using either device in a postural sway task, to that of able-bodied controls. Results showed that, compared with their passive prosthesis, the EMG-controlled prosthesis enabled participants to use near-normative postural control strategies, as evidenced by improved between-limb symmetry in intact-prosthetic center-of-pressure and joint angle excursions. Participants substantially improved postural stability, as evidenced by a reduction in steps or falls using the EMG-controlled prosthetic ankle. Furthermore, after relearning to use residual ankle muscles to drive the robotic ankle in postural control, nearly all participants’ motor module structure shifted toward that observed in individuals without limb amputations. Here, we have demonstrated the potential benefit of direct EMG control of robotic lower limb prostheses to restore normative postural control strategies (both neural and biomechanical) toward enhancing standing postural stability in amputee users.
-
more » « less
Previous research has shown that motion sickness associated with virtual vehicles is more common among passengers than among drivers. Separately, other studies have shown that postural precursors of motion sickness during virtual driving differ as a function of prior experience driving physical vehicles. We investigated the intersection of those prior effects: We asked whether decades of physical driving experience 1) would influence motion sickness among passengers in a virtual vehicle, and 2) would influence postural precursors of motion sickness among passengers in a virtual vehicle. In our study, middle-aged adults were exposed to a virtual vehicle as passengers. Some participants (Physical Drivers) had decades of experience driving physical automobiles, while others (Physical Non-Drivers) had rarely or never driven a physical vehicle. First, we measured head and torso movement as standing participants performed simple visual tasks. Then, each participant watched a recording of the motion of a virtual vehicle, which induced motion sickness in some participants. Afterward, neither the incidence nor the severity of motion sickness differed between Physical Drivers and Physical Non-Drivers. Our analysis of pre-exposure standing body sway revealed postural precursors of motion sickness in measures of the spatial magnitude and temporal dynamics of movement. In statistically significant interactions, these precursors (Well vs. Sick) differed as a function of physical driving experience (Physical Drivers vs. Physical Non-Drivers). Overall, our results indicate that, among virtual passengers, long-term real-world driving experience influenced the postural precursors of motion sickness, but not the incidence or severity of motion sickness. We discuss these results in terms of relationships between perception and motor control in theories of motion sickness etiology.
-
null (Ed.)Abstract Despite the promise of powered lower limb prostheses, existing controllers do not assist many daily activities that require continuous control of prosthetic joints according to human states and environments. The objective of this case study was to investigate the feasibility of direct, continuous electromyographic (dEMG) control of a powered ankle prosthesis, combined with physical therapist-guided training, for improved standing postural control in an individual with transtibial amputation. Specifically, EMG signals of the residual antagonistic muscles (i.e. lateral gastrocnemius and tibialis anterior) were used to proportionally drive pneumatical artificial muscles to move a prosthetic ankle. Clinical-based activities were used in the training and evaluation protocol of the control paradigm. We quantified the EMG signals in the bilateral shank muscles as well as measures of postural control and stability. Compared to the participant’s daily passive prosthesis, the dEMG-controlled ankle, combined with the training, yielded improved clinical balance scores and reduced compensation from intact joints. Cross-correlation coefficient of bilateral center of pressure excursions, a metric for quantifying standing postural control, increased to .83(±.07) when using dEMG ankle control ( passive device: .39(±.29)) . We observed synchronized activation of homologous muscles, rapid improvement in performance on the first day of the training for load transfer tasks, and further improvement in performance across training days (p = .006). This case study showed the feasibility of this dEMG control paradigm of a powered prosthetic ankle to assist postural control. This study lays the foundation for future study to extend these results through the inclusion of more participants and activities.more » « less
-
The Effect of Metacognitive Judgments on Metacognitive Awareness in an Augmented Reality EnvironmentBeing conscious of your thought processes is known as metacognition. It supports students in being more aware of their actions, motivations, and the potential applications of the skills [1]. This study investigates how different metacognitive judgment questions affect students’ metacognitive awareness in an augmented reality (AR) environment. The outcomes of this study will help us to understand what metacognitive monitoring method is more effective in the AR learning environment. According to the literature, students with high knowledge about cognition have higher test performance, while students with low regulation have a challenge during planning, organizing, and elaborating strategies. The dependent variables of the study are student learning performance and metacognitive awareness inventory (MAI) score, and one independent variable is the metacognitive judgment question Retrospective Confidence Judgment (RCJ) and Judgment of Learning (JOL). We hypothesized that the students with high performance would have improved MAI scores in both groups. The experiment was done with two groups (RCJ and JOL). Both groups responded to the pre-post metacognitive awareness inventory questionnaire. During the experiment, the MAI questionnaire was asked two times. In round one, the MAI questionnaire was asked at the beginning of lecture one; however, in round two, the questionnaire was asked at the end of lecture two. Results indicated significant differences in RCJ low performers. In RCJ, the participants whose performance was significantly reduced in lecture 2 had a higher improvement on MAI both regulation and knowledge about cognition. Overall, the result of our study could advance our understanding of how to design an advanced instructional strategy in an AR environment.more » « less
