skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Study of Graphic Armatures, Multimodal Cues, and Numeric Measures in Virtual Reality on Learners’ Performance and Workload
Virtual reality (VR) is increasingly utilized in education, yet its effectiveness can vary due to potential distractions and excessive workload. Prior research suggests that virtual signaling elements can enhance learning in VR environments. However, the effectiveness of different design elements for specific learning content and their impact on learner workload remain understudied. This study examines the influence of graphic armatures, multimodal cues, and numeric measures on scale learning in Scale Worlds, a VR learning environment for exploring scientific entities across multiple scales. Preliminary results indicate that numeric measures notably enhance learning outcomes by providing direct scale representations. It shows that different virtual elements can variably affect learners’ scale learning outcomes and behaviors and can lead to varying levels of workload. This study underscores the importance of aligning the design of virtual elements with educational objectives and ensuring they induce an appropriate level of workload for learning in VR learning environment.  more » « less
Award ID(s):
2055680
PAR ID:
10549753
Author(s) / Creator(s):
 ;  ;  ;  ;  ;  ;  
Publisher / Repository:
SAGE Publications
Date Published:
Journal Name:
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Volume:
68
Issue:
1
ISSN:
1071-1813
Format(s):
Medium: X Size: p. 1229-1234
Size(s):
p. 1229-1234
Sponsoring Org:
National Science Foundation
More Like this
  1. This preliminary study examined how users leveraged three different types of signaling elements in Scale Worlds, an immersive virtual reality (IVR) application designed to improve size and scale cognition. Signaling elements, which are instructional cues in the form of graphics, colors, sounds, or text in IVR, may improve learning outcomes by enhancing related cognitive processes. However, it is unclear the extent to which learners utilize these signaling elements in practice. A think-aloud protocol was used to examine how participants engaged with signaling elements, with thematic analysis suggesting that numerical measures were a particularly salient cue for conceptualizing the size and scale of entities in IVR. These findings can guide design decisions for future work on educational IVR in the context of size and scale cognition or STEM education, as implementing numerical measures to facilitate mathematical reasoning in IVR environments may bolster learning outcomes related to numeracy and conceptual understanding. 
    more » « less
  2. Traditional lectures have difficulties instilling pragmatic skills in construction engineering students due to the inability to illuminate the complexities within the human-robot collaborative construction environment. While on-site can acclimatize construction students to reality and construct knowledge that can solve safety challenges, it is challenging to organize on-site training trips owing to the dangerous nature of construction workplaces. This research aimed to explore virtual reality (VR) as a tool to enhance students’ perception and knowledge of construction robotic safety. For this purpose, the study developed a virtual training platform for providing construction engineering students with safety knowledge on interacting with simulated robots within the virtual environment of construction sites. A self-assessment approach was leveraged among 20 recruited students to demonstrate the efficacy of students’ engagement and learning outcomes from the proposed learning approach over the traditional learning approach. Results indicated a statistical difference in students’ learning outcomes and engagement levels between the developed approach and the traditional approach. Findings demonstrated the implications of VR as an experiential tool to enhance the students’ learning of robotic safety in construction. 
    more » « less
  3. Abstract The recent advancement in additive manufacturing (AM) leads to an extensive need for an industrial workforce in the near future. Workforce training in AM requires expensive capital investment for installing and maintaining this technology and proper knowledge about potential safety hazards. Traditional classroom settings often fail to bridge the critical gap between textbook learning and practical applications. Virtual reality (VR) training can simulate real‐world scenarios in a safe and controlled environment and improve student involvement to foster practical learning. In this paper, a virtual training platform for 3D printing has been developed and studied to improve AM education. The developed environment contains a selective laser sintering printer, a preparation station with necessary supplies, a control panel for process planning, and a post‐processing station. This platform provides students with excellent learning opportunities to gain hands‐on experiences and critical engineering skills on operating process parameters and safety measures. Undergraduate students majoring in industrial engineering were exposed to this learning approach to enhance their engagement and cognitive processing skills. Students' attentions were measured using eye metrics (fixation duration and preference index), and their exposure experiences were collected through the simulation sickness questionnaire, presence questionnaire, and system usability scale. Pre‐ and post‐VR training questionnaires and performance metrics (task completion time and accuracy) evaluated students' learning outcomes. Results provide valuable insights into students' attention, performance, and satisfaction with virtual training environments. Users' gaze behavior and subjective responses revealed many challenges that will help future researchers develop assistive instructions within this virtual educational platform. 
    more » « less
  4. Abstract Recent immersive mixed reality (MR) and virtual reality (VR) displays enable users to use their hands to interact with both veridical and virtual environments simultaneously. Therefore, it becomes important to understand the performance of human hand-reaching movement in MR. Studies have shown that different virtual environment visualization modalities can affect point-to-point reaching performance using a stylus, but it is not yet known if these effects translate to direct human-hand interactions in mixed reality. This paper focuses on evaluating human point-to-point motor performance in MR and VR for both finger-pointing and cup-placement tasks. Six performance measures relevant to haptic interface design were measured for both tasks under several different visualization conditions (“MR with indicator,” “MR without indicator,” and “VR”) to determine what factors contribute to hand-reaching performance. A key finding was evidence of a trade-off between reaching “motion confidence” measures (indicated by throughput, number of corrective movements, and peak velocity) and “accuracy” measures (indicated by end-point error and initial movement error). Specifically, we observed that participants tended to be more confident in the “MR without Indicator” condition for finger-pointing tasks. These results contribute critical knowledge to inform the design of VR/MR interfaces based on the application's user performance requirements. 
    more » « less
  5. null (Ed.)
    Virtual reality (VR) technology allows for the creation of fully immersive environments that enable personalized manufacturing learning. This case study discusses the development of a virtual learning factory that integrates manual and automated manufacturing processes such as welding, fastening, 3D printing, painting, and automated assembly. Two versions of the virtual factory are developed: (1) a multiplayer VR environment for the design and assembly of car toys; which allows for the collaboration of multiple users in the same VR environment, and (2) a virtual plant that utilizes heavy machinery and automated assembly lines for car manufacturing. The virtual factory also includes an intelligent avatar that can interact with the users and guide them to the different sections of the plant. The virtual factory enhances the learning of advanced manufacturing concepts by combining virtual objects with hands-on activities and providing students with an engaging learning experience. 
    more » « less