An official website of the United States government
The rapid advancement of digital technologies has transformed education by introducing immersive tools such as virtual reality (VR) and augmented reality (AR), which enhance learning through interactive and adaptive experiences. In construction, data-sensing technologies such as drones and laser scanners are increasingly used for site inspections, monitoring, and real-time decision-making. Training for these technologies often relies on VR simulations; however, traditional VR lacks hands-on realism, limiting users' ability to fully engage with these tools. Research suggests that embodied interaction, where users engage with tangible objects, can improve knowledge retention and task performance. However, its impact on mental workload remains underexplored. Workload, influenced by frustration, cognitive demands, and task complexity, can either enhance intuitiveness or increase strain. This study examines the effectiveness of immersive embodied interaction versus traditional VR in construction education and training. In a pilot study, 21 participants conducted drone-based site inspections under both conditions, with workload assessed using the NASA Task Load Index (NASA-TLX) survey. A paired samples t-test revealed a statistically significant reduction in workload in the embodied interaction condition (t(20) = -4.31, p < .001), indicating that participants experienced lower cognitive demands compared to the traditional VR method. These findings suggest that embodied interaction not only reduces workload but also enhances knowledge retention and task performance, reinforcing its potential as an effective training method in construction-related educational environments.
more »
« less
This content will become publicly available on June 23, 2027
Comparing VR and 2D game environments on mental workload, emotion and situation awareness: implications for rehabilitation game design
PurposeVirtual reality (VR) games are increasingly being explored as tools for physical and mental rehabilitation, yet their cognitive and psychological demands relative to conventional 2D games remain insufficiently understood. In rehabilitation-oriented tasks, factors such as mental workload (MWL), situational awareness (SA) and affect play a critical role in adherence and safety. As an initial, pre-clinical step, this study examines how these demands differ between immersive VR and traditional 2D gameplay. Design/methodology/approachA within-subjects study was conducted with 21 healthy adults who performed game-based tasks of varying difficulty in both VR and 2D environments. MWL, affect and SA were assessed after each condition using self-assessment questionnaires. FindingsCompared with the 2D environment, VR resulted in significantly higher overall MWL, effort and physical demand, particularly at the easier task difficulty. VR was also associated with higher negative affect at the easy level; however, negative affect did not further increase at the high level, while positive affect remained stable across difficulty levels. Originality/valueThe findings offer foundational insight into the cognitive and affective demands associated with immersive VR gameplay prior to clinical application. The results underscore the need to balance workload, task difficulty and emotional intensity in the design of rehabilitation-oriented VR games, especially in scenarios where exercises are inherently challenging and sustained engagement is essential.
more »
« less
- Award ID(s):
- 2045848
- PAR ID:
- 10693335
- Publisher / Repository:
- emerald.com
- Date Published:
- Journal Name:
- Journal of Enabling Technologies
- ISSN:
- 2398-6263
- Page Range / eLocation ID:
- 1 to 14
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
ObjectiveThe goal of this study was to assess how different real-time gaze sharing visualization techniques affect eye tracking metrics, workload, team situation awareness (TSA), and team performance. BackgroundGaze sharing is a real-time visualization technique that allows teams to know where their team members are looking on a shared display. Gaze sharing visualization techniques are a promising means to improve collaborative performance on simple tasks; however, there needs to be validation of gaze sharing with more complex and dynamic tasks. MethodsThis study evaluated the effect of gaze sharing on eye tracking metrics, workload, team SA, and team performance in a simulated unmanned aerial vehicle (UAV) command-and-control task. Thirty-five teams of two performed UAV tasks under three conditions: one with no gaze sharing and two with gaze sharing. Gaze sharing was presented using a fixation dot (i.e., a translucent colored dot) and a fixation trail (i.e., a trail of the most recent fixations). ResultsThe results showed that the fixation trail significantly reduced saccadic activity, lowered workload, supported team SA at all levels, and improved performance compared to no gaze sharing; however, the fixation dot had the opposite effect on performance and SA. In fact, having no gaze sharing outperformed the fixation dot. Participants also preferred the fixation trail for its visibility and ability to track and monitor the history of their partner’s gaze. ConclusionThe results showed that gaze sharing has the potential to support collaboration, but its effectiveness depends highly on the design and context of use. ApplicationThe findings suggest that gaze sharing visualization techniques, like the fixation trail, have the potential to improve teamwork in complex UAV tasks and could have broader applicability in a variety of collaborative settings.more » « less
-
Robot teleoperation has become increasingly crucial for extending human capabilities in inaccessible or hazardous environments and facilitating human–robot collaboration. While significant advancements have been made in teleoperation interfaces, the success of these systems critically depends on how effectively humans can interact with and control robotic systems across diverse manipulation tasks. However, existing research primarily evaluates interfaces within specific tasks or applications, lacking systematic assessment across different manipulation scenarios. This limitation leads to suboptimal interface selection that can compromise task efficiency in critical domains and impede the collection of high-quality demonstrations for robot learning. To address these gaps, we first introduce a novel two-axis Robotic Manipulation Task Taxonomy that systematically categorizes manipulation tasks based on their fundamental control requirements: Motion Type (translation-dominant vs. rotation-dominant) and Engagement Type (rigid vs. non-rigid object interactions). We conducted a comprehensive user study (\(n=30\)) evaluating three distinct teleoperation interfaces (Gamepad, 3D Mouse, and Virtual Reality (VR) Controller) based on this taxonomy. Our results indicate that the Gamepad and 3D mouse significantly outperformed the VR Controller in task completion time across all task categories. In contrast, the VR Controller showed higher first-attempt success rates but caused significantly greater cognitive load across all NASA Task Load Index (NASA-TLX) subscales compared to the Gamepad interface, and specifically higher mental demand, physical demand, and effort compared to the 3D mouse. Our results also indicate that although prior familiarity with an interface lowered perceived workload and enhanced perceived performance, it did not translate into improvements in actual task success rates or completion times. These insights provide valuable guidelines for optimizing teleoperation interfaces based on task requirements and highlight the importance of considering both cognitive demands and user experience in interface design.more » « less
-
Owing to the increasing dynamics and complexity of construction tasks, workers often need to memorize a big amount of engineering information prior to the operations, such as spatial orientations and operational procedures. The working memory development, as a result, is critical to the performance and safety of many construction tasks. This study investigates how the format of engineering information affects human working memory based on a human-subject Virtual Reality (VR) experiment (n=90). A VR model was created to simulate a pipe maintenance task. First, participants were asked to review the task procedures in one of the following formats, including 2D isometric drawings, 3D model, and VR model. After the review session, participants were asked to perform the pipe maintenance task in the virtual environment based on their working memory. The operation accuracy and time were used as the key performance indicators of the working memory development. The experiment results indicate that the 3D and VR groups outperformed the 2D group in both operation accuracy and time, suggesting that a more immersive instruction leads to a better working memory. A further examination finds that the 2D group presented a significantly higher level of intrinsic cognitive load and extraneous cognitive load in the working memory development compared to the 3D and VR groups, indicating that different engineering information formats can cause different levels of cognitive load in working memory development, and ultimately affect the final performance. The findings are expected to inspire the design of intelligent information systems that adapt to the cognitive load of construction workers for improved working memory development.more » « less
-
Introduction:Neurological disorders, such as multiple sclerosis (MS), can significantly impair bodily functions due to the immune system mistakenly attacking the body. Assessing cognitive workload in MS patients is crucial for understanding their condition, and one effective approach is the use of ann-back working memory task combined with magnetoencephalography (MEG) recordings. MEG provides valuable insights into brain activity through its magnetic signals. Methods:This study proposes an automated framework to detect mental workload levels in MS patients using MEG data. The EEGNet model is employed to assess mental workload, with transfer learning techniques used for fine-tuning to enhance model performance. Additionally, traditional machine learning models are evaluated to compare their performance with the deep learning-based approach. Results:Experimental results indicate that the proposed model achieves an accuracy of 51.68 ± 11.92% for healthy subjects and 51.77 ± 13.29% for MS patients across various workload levels, significantly outperforming baseline methods. Conclusions:Deep learning-based end-to-end models can effectively assess mental workload in MS patients, achieving competitive performance without requiring explicit feature extraction or dimensionality reduction steps typically used in conventional classification pipelines.more » « less
