An official website of the United States government
This article provides a systematic review of research related to Human–Computer Interaction techniques supporting training and learning in various domains including medicine, healthcare, and engineering. The focus is on HCI techniques involving Extended Reality (XR) technology which encompasses Virtual Reality, Augmented Reality, and Mixed Reality. HCI-based research is assuming more importance with the rapid adoption of XR tools and techniques in various training and learning contexts including education. There are many challenges in the adoption of HCI approaches, which results in a need to have a comprehensive and systematic review of such HCI methods in various domains. This article addresses this need by providing a systematic literature review of a cross-s Q1 ection of HCI approaches involving proposed so far. The PRISMA-guided search strategy identified 1156 articles for abstract review. Irrelevant abstracts were discarded. The whole body of each article was reviewed for the remaining articles, and those that were not linked to the scope of our specific issue were also eliminated. Following the application of inclusion/exclusion criteria, 69 publications were chosen for review. This article has been divided into the following sections: Introduction; Research methodology; Literature review; Threats of validity; Future research and Conclusion. Detailed classifications (pertaining to HCI criteria and concepts, such as affordance; training, and learning techniques) have also been included based on different parameters based on the analysis of research techniques adopted by various investigators. The article concludes with a discussion of the key challenges for this HCI area along with future research directions. A review of the research outcomes from these publications underscores the potential for greater success when such HCI-based approaches are adopted during such 3D-based training interactions. Such a higher degree of success may be due to the emphasis on the design of userfriendly (and user-centric) training environments, interactions, and processes that positively impact the cognitive abilities of users and their respective learning/training experiences. We discovered data validating XR-HCI as an ascending method that brings a new paradigm by enhancing skills and safety while reducing costs and learning time through replies to three exploratory study questions. We believe that the findings of this study will aid academics in developing new research avenues that will assist XR-HCI applications to mature and become more widely adopted.
more »
« less
Effect of Tactile Affordance During the Design of Extended Reality-Based Training Environments for Healthcare Contexts
In this paper, the effect of tactile affordance during the design of Extended Reality (XR) based environments is presented. Tactile affordance is one of the Human eXtended Reality Interaction (HXRI) criteria which help lay the foundation for human-centricXR-based training environments. XR-based training environments developed for two surgical procedures have been used to study the role of tactile affordance. The first XR environment is developed for the Condylar plating surgical procedure which is performed to treat the fractures of the femur bone and the second XR environment is developed to train users in endotracheal intubation. Three studies have been conducted to understand the influence of different interactionmethods to elevate tactile affordance in XR-based environments. The studies and the results of the studies have been exhaustively discussed in this paper.
more »
« less
- PAR ID:
- 10435919
- Editor(s):
- Chen, J.Y.C.
- Date Published:
- Journal Name:
- International Conference on Human-Computer Interaction, July 23-28, 2023
- Volume:
- 14027
- Page Range / eLocation ID:
- 441–452
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The combination of Visual Guidance and Extended Reality (XR) technology holds the potential to greatly improve the performance of human workforces in numerous areas, particularly industrial environments. Focusing on virtual assembly tasks and making use of different forms of supportive visualisations, this study investigates the potential of XR Visual Guidance. Set in a web-based immersive environment, our results draw from a heterogeneous pool of 199 participants. This research is designed to significantly differ from previous exploratory studies, which yielded conflicting results on user performance and associated human factors. Our results clearly show the advantages of XR Visual Guidance based on an over 50% reduction in task completion times and mistakes made; this may further be enhanced and refined using specific frameworks and other forms of visualisations/Visual Guidance. Discussing the role of other factors, such as cognitive load, motivation, and usability, this paper also seeks to provide concrete avenues for future research and practical takeaways for practitioners.more » « less
-
Impact of extended reality on robot-assisted surgery training: a systematic review and meta-analysisAbstract Robot-assisted surgeries (RAS) have an extremely steep learning curve. Because of this, surgeons have created many methods to practice RAS outside the operating room. These training models usually include animal or plastic models; however, extended reality simulators have recently been introduced into surgical training programs. This systematic review and meta-analysis was conducted to determine if extended reality simulators can improve the performance of robotic novices and how their performance compares to the conventional training of surgeons on surgical robots. Using the PRISMA 2020 guidelines, a systematic review was performed searching PubMed, Embase, Web of Science, and Cochrane library for studies that compared the performance of robotic novices that received no additional training, trained with extended reality, or trained with inanimate physical simulators (conventional additional training). Articles that gauged performance using GEARS or time to complete measurements were included, while articles that did not make this comparison were excluded. A meta-analysis was performed on the 15 studies found using SPSS to compare the performance outcomes of the novices after training. Robotic novices trained with extended reality simulators showed a statistically significant improvement in time to complete (Cohen’s d = −0.95,p = 0.02) compared to those with no additional training. Extended reality training also showed no statistically significant difference in performance in time to complete (Cohen’s d = 0.65,p = 0.14) or GEARS scores (Cohen’s d = −0.093, p = 0.34) compared to robotic novices trained with conventional models. This meta-analysis seeks to determine if extended reality simulators translate complex skills to surgeons in a low-cost and low-risk environment.more » « less
-
Annotation in 3D user interfaces such as Augmented Reality (AR) and Virtual Reality (VR) is a challenging and promising area; however, there are not currently surveys reviewing these contributions. In order to provide a survey of annotations for Extended Reality (XR) environments, we conducted a structured literature review of papers that used annotation in their AR/VR systems from the period between 2001 and 2021. Our literature review process consists of several filtering steps which resulted in 103 XR publications with a focus on annotation. We classified these papers based on the display technologies, input devices, annotation types, target object under annotation, collaboration type, modalities, and collaborative technologies. A survey of annotation in XR is an invaluable resource for researchers and newcomers. Finally, we provide a database of the collected information for each reviewed paper. This information includes applications, the display technologies and its annotator, input devices, modalities, annotation types, interaction techniques, collaboration types, and tasks for each paper. This database provides a rapid access to collected data and gives users the ability to search or filter the required information. This survey provides a starting point for anyone interested in researching annotation in XR environments.more » « less
-
This alternative format session provides a forum for human factors scholars and practitioners to showcase how state-of-the-art extended reality (XR) applications are being used in academia, defense, and industry to address human factors research. The session will begin with short introductions from each presenter to describe their XR application. Afterward, session attendees will engage with the presenters and their demonstrations, which will be set up around the demonstration floor room. This year’s showcase features XR applications in STEM education, medical and aviation training, agricultural data visualization, homeland security, training design, and visitor engagement in informal learning settings. Our goal is for attendees to experience how human factors professionals use XR to support human factors-oriented research and to learn about the exciting work being conducted with these emerging technologies.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1007/978-3-031-35634-6_31
