skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Utilizing a Learning Strategy Analysis to Determine a System’s Potential Impact on Student Learning: The Augmented-Reality Emotive Virtual Patient System Platform
A learning strategy analysis was performed on the Emotive Virtual Patient System, an augmented reality platform that teaches medical students doctor-patient communication skills. The Emotive Virtual Patient System is a complex mixed reality platform that includes both virtual and human peers/instructors who use natural language processing to provide feedback and dialog modeling as a means to improve patient communication learning outcomes. The learning strategy analysis (i.e., system learning strategy/component review, literature review, and heuristic evaluation of best practices) was conducted on the early system plans to determine its potential in supporting student learning and to provide shortand-long-term design considerations. The analysis identified three major categories for potential consideration: verbal interactions, user groups/system objective monitoring, and security. Specific recommendations were given for each of these areas, as supported by the literature.  more » « less
Award ID(s):
1917994
PAR ID:
10335910
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Volume:
65
Issue:
1
ISSN:
2169-5067
Page Range / eLocation ID:
1562 to 1566
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Tang, Pingbo; Grau, David; Asmar, Mounir E. (Ed.)
    Effective construction engineering and management education requires hands-on experiences that have not traditionally been offered in classroom settings. Physical building competitions like Solar Decathlon are valuable for providing experiential learning opportunities that may support tacit and explicit knowledge development among students, but they are often not available to all students due to funding and resource limitations. Less resource intensive teaching strategies, such as project based learning, can mimic the benefit of physical experiences by providing context to learning content. This paper reviews project based learning literature to identify trends in reported learning gains from the adoption of this strategy. Additionally, emerging technologies offer the ability to create low cost, immersive multimedia environments that may be able to support the types of learning targeted by physical design and construction experiences. Literature on multimedia learning theory is explored to identify opportunities for multimedia applications to facilitate learnings derived by physical educational contexts, but with the use of increasingly affordable multimedia strategies. This paper resulted in identifying six learning gains that have a theoretical potential to be facilitated using augmented reality and virtual reality technologies. The theoretical potential was deduced based on prior research on teaching strategies that provide real-world context to learning content. The authors of this paper propose using the identified learning gains as targets to specifically design implementation studies to verify this potential. The learning gains identified in the results section can be targeted and measured in future research when empirically validating the use of immersive technologies for construction education. The contribution of this work is in synthesizing the learning gains that future researchers should target based on evidence from prior research in related learning contexts. 
    more » « less
  2. Effective construction engineering and management education requires hands-on experiences that have not traditionally been offered in classroom settings. Physical building competitions like Solar Decathlon are valuable for providing experiential learning opportunities that may support tacit and explicit knowledge development among students, but they are often not available to all students due to funding and resource limitations. Less resource intensive teaching strategies, such as project based learning, can mimic the benefit of physical experiences by providing context to learning content. This paper reviews project based learning literature to identify trends in reported learning gains from the adoption of this strategy. Additionally, emerging technologies offer the ability to create low cost, immersive multimedia environments that may be able to support the types of learning targeted by physical design and construction experiences. Literature on multimedia learning theory is explored to identify opportunities for multimedia applications to facilitate learnings derived by physical educational contexts, but with the use of increasingly affordable multimedia strategies. This paper resulted in identifying six learning gains that have a theoretical potential to be facilitated using augmented reality and virtual reality technologies. The theoretical potential was deduced based on prior research on teaching strategies that provide real-world context to learning content. The authors of this paper propose using the identified learning gains as targets to specifically design implementation studies to verify this potential. The learning gains identified in the results section can be targeted and measured in future research when empirically validating the use of immersive technologies for construction education. The contribution of this work is in synthesizing the learning gains that future researchers should target based on evidence from prior research in related learning contexts. 
    more » « less
  3. This article provides a systematic review of research related to Human–Computer Interaction techniques supporting training and learning in various domains including medicine, healthcare, and engineering. The focus is on HCI techniques involving Extended Reality (XR) technology which encompasses Virtual Reality, Augmented Reality, and Mixed Reality. HCI-based research is assuming more importance with the rapid adoption of XR tools and techniques in various training and learning contexts including education. There are many challenges in the adoption of HCI approaches, which results in a need to have a comprehensive and systematic review of such HCI methods in various domains. This article addresses this need by providing a systematic literature review of a cross-s Q1 ection of HCI approaches involving proposed so far. The PRISMA-guided search strategy identified 1156 articles for abstract review. Irrelevant abstracts were discarded. The whole body of each article was reviewed for the remaining articles, and those that were not linked to the scope of our specific issue were also eliminated. Following the application of inclusion/exclusion criteria, 69 publications were chosen for review. This article has been divided into the following sections: Introduction; Research methodology; Literature review; Threats of validity; Future research and Conclusion. Detailed classifications (pertaining to HCI criteria and concepts, such as affordance; training, and learning techniques) have also been included based on different parameters based on the analysis of research techniques adopted by various investigators. The article concludes with a discussion of the key challenges for this HCI area along with future research directions. A review of the research outcomes from these publications underscores the potential for greater success when such HCI-based approaches are adopted during such 3D-based training interactions. Such a higher degree of success may be due to the emphasis on the design of userfriendly (and user-centric) training environments, interactions, and processes that positively impact the cognitive abilities of users and their respective learning/training experiences. We discovered data validating XR-HCI as an ascending method that brings a new paradigm by enhancing skills and safety while reducing costs and learning time through replies to three exploratory study questions. We believe that the findings of this study will aid academics in developing new research avenues that will assist XR-HCI applications to mature and become more widely adopted. 
    more » « less
  4. null (Ed.)
    There is a cohesive body of research on the effectiveness of problem-based learning (PBL) for a wide range of learner groups across different disciplines in engineering education. On the other hand, there is a growing interest in using immersive technologies such as virtual reality (VR) in engineering education. While there are many literature review articles on each of these subjects separately, there is a lack of review articles on the application of combined PBL-VR learning environments in engineering education. This paper provides an assessment of the applications and potential of implementing immersive technologies in a PBL setting to utilize the advantages of both paradigms. More specifically, this paper aims to provide insights related to two main questions: (1) where (in what disciplines/subjects) PBL and VR have been used together in engineering education? And, (2) how are VR and PBL integrated and used in engineering education? The first question is investigated by performing a bibliometric analysis of relevant papers published in the proceedings of previous ASEE annual conferences. The second question is explored by performing a literature review and classification of ASEE papers that discuss the use of VR in conjunction with PBL. Our findings reveal a gap between the application of integrated PBL and VR across different disciplines in engineering education. We also analyze the trends related to PBL and VR application in engineering education over time. Finally, we identify and propose future opportunities related to the combination of PBL and immersive technologies, including but not limited to immersive simulation-based learning (ISBL) and incorporating artificial intelligence (AI) into immersive virtual/simulated learning environments used in engineering education. 
    more » « less
  5. Abstract The recent advancement in additive manufacturing (AM) leads to an extensive need for an industrial workforce in the near future. Workforce training in AM requires expensive capital investment for installing and maintaining this technology and proper knowledge about potential safety hazards. Traditional classroom settings often fail to bridge the critical gap between textbook learning and practical applications. Virtual reality (VR) training can simulate real‐world scenarios in a safe and controlled environment and improve student involvement to foster practical learning. In this paper, a virtual training platform for 3D printing has been developed and studied to improve AM education. The developed environment contains a selective laser sintering printer, a preparation station with necessary supplies, a control panel for process planning, and a post‐processing station. This platform provides students with excellent learning opportunities to gain hands‐on experiences and critical engineering skills on operating process parameters and safety measures. Undergraduate students majoring in industrial engineering were exposed to this learning approach to enhance their engagement and cognitive processing skills. Students' attentions were measured using eye metrics (fixation duration and preference index), and their exposure experiences were collected through the simulation sickness questionnaire, presence questionnaire, and system usability scale. Pre‐ and post‐VR training questionnaires and performance metrics (task completion time and accuracy) evaluated students' learning outcomes. Results provide valuable insights into students' attention, performance, and satisfaction with virtual training environments. Users' gaze behavior and subjective responses revealed many challenges that will help future researchers develop assistive instructions within this virtual educational platform. 
    more » « less