skip to main content


Title: Utilizing a Learning Strategy Analysis to Determine a System’s Potential Impact on Student Learning: The Augmented-Reality Emotive Virtual Patient System Platform
A learning strategy analysis was performed on the Emotive Virtual Patient System, an augmented reality platform that teaches medical students doctor-patient communication skills. The Emotive Virtual Patient System is a complex mixed reality platform that includes both virtual and human peers/instructors who use natural language processing to provide feedback and dialog modeling as a means to improve patient communication learning outcomes. The learning strategy analysis (i.e., system learning strategy/component review, literature review, and heuristic evaluation of best practices) was conducted on the early system plans to determine its potential in supporting student learning and to provide shortand-long-term design considerations. The analysis identified three major categories for potential consideration: verbal interactions, user groups/system objective monitoring, and security. Specific recommendations were given for each of these areas, as supported by the literature.  more » « less
Award ID(s):
1917994
NSF-PAR ID:
10335910
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Volume:
65
Issue:
1
ISSN:
2169-5067
Page Range / eLocation ID:
1562 to 1566
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    There is a cohesive body of research on the effectiveness of problem-based learning (PBL) for a wide range of learner groups across different disciplines in engineering education. On the other hand, there is a growing interest in using immersive technologies such as virtual reality (VR) in engineering education. While there are many literature review articles on each of these subjects separately, there is a lack of review articles on the application of combined PBL-VR learning environments in engineering education. This paper provides an assessment of the applications and potential of implementing immersive technologies in a PBL setting to utilize the advantages of both paradigms. More specifically, this paper aims to provide insights related to two main questions: (1) where (in what disciplines/subjects) PBL and VR have been used together in engineering education? And, (2) how are VR and PBL integrated and used in engineering education? The first question is investigated by performing a bibliometric analysis of relevant papers published in the proceedings of previous ASEE annual conferences. The second question is explored by performing a literature review and classification of ASEE papers that discuss the use of VR in conjunction with PBL. Our findings reveal a gap between the application of integrated PBL and VR across different disciplines in engineering education. We also analyze the trends related to PBL and VR application in engineering education over time. Finally, we identify and propose future opportunities related to the combination of PBL and immersive technologies, including but not limited to immersive simulation-based learning (ISBL) and incorporating artificial intelligence (AI) into immersive virtual/simulated learning environments used in engineering education. 
    more » « less
  2. This article provides a systematic review of research related to Human–Computer Interaction techniques supporting training and learning in various domains including medicine, healthcare, and engineering. The focus is on HCI techniques involving Extended Reality (XR) technology which encompasses Virtual Reality, Augmented Reality, and Mixed Reality. HCI-based research is assuming more importance with the rapid adoption of XR tools and techniques in various training and learning contexts including education. There are many challenges in the adoption of HCI approaches, which results in a need to have a comprehensive and systematic review of such HCI methods in various domains. This article addresses this need by providing a systematic literature review of a cross-s Q1 ection of HCI approaches involving proposed so far. The PRISMA-guided search strategy identified 1156 articles for abstract review. Irrelevant abstracts were discarded. The whole body of each article was reviewed for the remaining articles, and those that were not linked to the scope of our specific issue were also eliminated. Following the application of inclusion/exclusion criteria, 69 publications were chosen for review. This article has been divided into the following sections: Introduction; Research methodology; Literature review; Threats of validity; Future research and Conclusion. Detailed classifications (pertaining to HCI criteria and concepts, such as affordance; training, and learning techniques) have also been included based on different parameters based on the analysis of research techniques adopted by various investigators. The article concludes with a discussion of the key challenges for this HCI area along with future research directions. A review of the research outcomes from these publications underscores the potential for greater success when such HCI-based approaches are adopted during such 3D-based training interactions. Such a higher degree of success may be due to the emphasis on the design of userfriendly (and user-centric) training environments, interactions, and processes that positively impact the cognitive abilities of users and their respective learning/training experiences. We discovered data validating XR-HCI as an ascending method that brings a new paradigm by enhancing skills and safety while reducing costs and learning time through replies to three exploratory study questions. We believe that the findings of this study will aid academics in developing new research avenues that will assist XR-HCI applications to mature and become more widely adopted. 
    more » « less
  3. Tang, Pingbo ; Grau, David ; Asmar, Mounir E. (Ed.)
    Effective construction engineering and management education requires hands-on experiences that have not traditionally been offered in classroom settings. Physical building competitions like Solar Decathlon are valuable for providing experiential learning opportunities that may support tacit and explicit knowledge development among students, but they are often not available to all students due to funding and resource limitations. Less resource intensive teaching strategies, such as project based learning, can mimic the benefit of physical experiences by providing context to learning content. This paper reviews project based learning literature to identify trends in reported learning gains from the adoption of this strategy. Additionally, emerging technologies offer the ability to create low cost, immersive multimedia environments that may be able to support the types of learning targeted by physical design and construction experiences. Literature on multimedia learning theory is explored to identify opportunities for multimedia applications to facilitate learnings derived by physical educational contexts, but with the use of increasingly affordable multimedia strategies. This paper resulted in identifying six learning gains that have a theoretical potential to be facilitated using augmented reality and virtual reality technologies. The theoretical potential was deduced based on prior research on teaching strategies that provide real-world context to learning content. The authors of this paper propose using the identified learning gains as targets to specifically design implementation studies to verify this potential. The learning gains identified in the results section can be targeted and measured in future research when empirically validating the use of immersive technologies for construction education. The contribution of this work is in synthesizing the learning gains that future researchers should target based on evidence from prior research in related learning contexts. 
    more » « less
  4. Effective construction engineering and management education requires hands-on experiences that have not traditionally been offered in classroom settings. Physical building competitions like Solar Decathlon are valuable for providing experiential learning opportunities that may support tacit and explicit knowledge development among students, but they are often not available to all students due to funding and resource limitations. Less resource intensive teaching strategies, such as project based learning, can mimic the benefit of physical experiences by providing context to learning content. This paper reviews project based learning literature to identify trends in reported learning gains from the adoption of this strategy. Additionally, emerging technologies offer the ability to create low cost, immersive multimedia environments that may be able to support the types of learning targeted by physical design and construction experiences. Literature on multimedia learning theory is explored to identify opportunities for multimedia applications to facilitate learnings derived by physical educational contexts, but with the use of increasingly affordable multimedia strategies. This paper resulted in identifying six learning gains that have a theoretical potential to be facilitated using augmented reality and virtual reality technologies. The theoretical potential was deduced based on prior research on teaching strategies that provide real-world context to learning content. The authors of this paper propose using the identified learning gains as targets to specifically design implementation studies to verify this potential. The learning gains identified in the results section can be targeted and measured in future research when empirically validating the use of immersive technologies for construction education. The contribution of this work is in synthesizing the learning gains that future researchers should target based on evidence from prior research in related learning contexts. 
    more » « less
  5. Background Over the past 2 decades, various desktop and mobile telemedicine systems have been developed to support communication and care coordination among distributed medical teams. However, in the hands-busy care environment, such technologies could become cumbersome because they require medical professionals to manually operate them. Smart glasses have been gaining momentum because of their advantages in enabling hands-free operation and see-what-I-see video-based consultation. Previous research has tested this novel technology in different health care settings. Objective The aim of this study was to review how smart glasses were designed, used, and evaluated as a telemedicine tool to support distributed care coordination and communication, as well as highlight the potential benefits and limitations regarding medical professionals’ use of smart glasses in practice. Methods We conducted a literature search in 6 databases that cover research within both health care and computer science domains. We used the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology to review articles. A total of 5865 articles were retrieved and screened by 3 researchers, with 21 (0.36%) articles included for in-depth analysis. Results All of the reviewed articles (21/21, 100%) used off-the-shelf smart glass device and videoconferencing software, which had a high level of technology readiness for real-world use and deployment in care settings. The common system features used and evaluated in these studies included video and audio streaming, annotation, augmented reality, and hands-free interactions. These studies focused on evaluating the technical feasibility, effectiveness, and user experience of smart glasses. Although the smart glass technology has demonstrated numerous benefits and high levels of user acceptance, the reviewed studies noted a variety of barriers to successful adoption of this novel technology in actual care settings, including technical limitations, human factors and ergonomics, privacy and security issues, and organizational challenges. Conclusions User-centered system design, improved hardware performance, and software reliability are needed to realize the potential of smart glasses. More research is needed to examine and evaluate medical professionals’ needs, preferences, and perceptions, as well as elucidate how smart glasses affect the clinical workflow in complex care environments. Our findings inform the design, implementation, and evaluation of smart glasses that will improve organizational and patient outcomes. 
    more » « less