This alternative format session provides a forum for human factors scholars and practitioners to showcase how state-of-the-art extended reality (XR) applications are being used in academia, defense, and industry to address human factors research. The session will begin with short introductions from each presenter to describe their XR application. Afterward, session attendees will engage with the presenters and their demonstrations, which will be set up around the demonstration floor room. This year’s showcase features XR applications in STEM education, medical and aviation training, agricultural data visualization, homeland security, training design, and visitor engagement in informal learning settings. Our goal is for attendees to experience how human factors professionals use XR to support human factors-oriented research and to learn about the exciting work being conducted with these emerging technologies.
more »
« less
A Review of Extended Reality (XR) Technologies for Manufacturing Training
Recently, the use of extended reality (XR) systems has been on the rise, to tackle various domains such as training, education, safety, etc. With the recent advances in augmented reality (AR), virtual reality (VR) and mixed reality (MR) technologies and ease of availability of high-end, commercially available hardware, the manufacturing industry has seen a rise in the use of advanced XR technologies to train its workforce. While several research publications exist on applications of XR in manufacturing training, a comprehensive review of recent works and applications is lacking to present a clear progress in using such advance technologies. To this end, we present a review of the current state-of-the-art of use of XR technologies in training personnel in the field of manufacturing. First, we put forth the need of XR in manufacturing. We then present several key application domains where XR is being currently applied, notably in maintenance training and in performing assembly task. We also reviewed the applications of XR in other vocational domains and how they can be leveraged in the manufacturing industry. We finally present some current barriers to XR adoption in manufacturing training and highlight the current limitations that should be considered when looking to develop and apply practical applications of XR.
more »
« less
- Award ID(s):
- 1719031
- PAR ID:
- 10467949
- Publisher / Repository:
- MDPI
- Date Published:
- Journal Name:
- Technologies
- Volume:
- 8
- Issue:
- 4
- ISSN:
- 2227-7080
- Page Range / eLocation ID:
- 77
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This article provides a systematic review of research related to Human–Computer Interaction techniques supporting training and learning in various domains including medicine, healthcare, and engineering. The focus is on HCI techniques involving Extended Reality (XR) technology which encompasses Virtual Reality, Augmented Reality, and Mixed Reality. HCI-based research is assuming more importance with the rapid adoption of XR tools and techniques in various training and learning contexts including education. There are many challenges in the adoption of HCI approaches, which results in a need to have a comprehensive and systematic review of such HCI methods in various domains. This article addresses this need by providing a systematic literature review of a cross-s Q1 ection of HCI approaches involving proposed so far. The PRISMA-guided search strategy identified 1156 articles for abstract review. Irrelevant abstracts were discarded. The whole body of each article was reviewed for the remaining articles, and those that were not linked to the scope of our specific issue were also eliminated. Following the application of inclusion/exclusion criteria, 69 publications were chosen for review. This article has been divided into the following sections: Introduction; Research methodology; Literature review; Threats of validity; Future research and Conclusion. Detailed classifications (pertaining to HCI criteria and concepts, such as affordance; training, and learning techniques) have also been included based on different parameters based on the analysis of research techniques adopted by various investigators. The article concludes with a discussion of the key challenges for this HCI area along with future research directions. A review of the research outcomes from these publications underscores the potential for greater success when such HCI-based approaches are adopted during such 3D-based training interactions. Such a higher degree of success may be due to the emphasis on the design of userfriendly (and user-centric) training environments, interactions, and processes that positively impact the cognitive abilities of users and their respective learning/training experiences. We discovered data validating XR-HCI as an ascending method that brings a new paradigm by enhancing skills and safety while reducing costs and learning time through replies to three exploratory study questions. We believe that the findings of this study will aid academics in developing new research avenues that will assist XR-HCI applications to mature and become more widely adopted.more » « less
-
Annotation in 3D user interfaces such as Augmented Reality (AR) and Virtual Reality (VR) is a challenging and promising area; however, there are not currently surveys reviewing these contributions. In order to provide a survey of annotations for Extended Reality (XR) environments, we conducted a structured literature review of papers that used annotation in their AR/VR systems from the period between 2001 and 2021. Our literature review process consists of several filtering steps which resulted in 103 XR publications with a focus on annotation. We classified these papers based on the display technologies, input devices, annotation types, target object under annotation, collaboration type, modalities, and collaborative technologies. A survey of annotation in XR is an invaluable resource for researchers and newcomers. Finally, we provide a database of the collected information for each reviewed paper. This information includes applications, the display technologies and its annotator, input devices, modalities, annotation types, interaction techniques, collaboration types, and tasks for each paper. This database provides a rapid access to collected data and gives users the ability to search or filter the required information. This survey provides a starting point for anyone interested in researching annotation in XR environments.more » « less
-
Many have predicted the future of the Web to be the integration of Web content with the real-world through technologies such as Augmented Reality (AR). This has led to the rise of Extended Reality (XR) Web Browsers used to shorten the long AR application development and deployment cycle of native applications especially across different platforms. As XR Browsers mature, we face new challenges related to collaborative and multi-user applications that span users, devices, and machines. These collaborative XR applications require: (1) networking support for scaling to many users, (2) mechanisms for content access control and application isolation, and (3) the ability to host application logic near clients or data sources to reduce application latency. In this paper, we present the design and evaluation of the AR Edge Networking Architecture (ARENA) which is a platform that simplifies building and hosting collaborative XR applications on WebXR capable browsers. ARENA provides a number of critical components including: a hierarchical geospatial directory service that connects users to nearby servers and content, a token-based authentication system for controlling user access to content, and an application/service runtime supervisor that can dispatch programs across any network connected device. All of the content within ARENA exists as endpoints in a PubSub scene graph model that is synchronized across all users. We evaluate ARENA in terms of client performance as well as benchmark end-to-end response-time as load on the system scales. We show the ability to horizontally scale the system to Internet-scale with scenes containing hundreds of users and latencies on the order of tens of milliseconds. Finally, we highlight projects built using ARENA and showcase how our approach dramatically simplifies collaborative multi-user XR development compared to monolithic approaches.more » « less
-
The educational applications of extended reality (XR) modalities, including virtual reality (VR), augmented reality (AR), and mixed reality (MR), have increased significantly over the last ten years. Many educators within the Architecture, Engineering, and Construction (AEC) related degree programs see student benefits that could be derived from bringing these modalities into classrooms, which include but are not limited to: a better understanding of each of the subdisciplines and the coordination necessary between them, visualizing oneself as a professional in AEC, and visualization of difficult concepts to increase engagement, self-efficacy, and learning. These benefits, in turn, help recruitment and retention efforts for these degree programs. However, given the number of technologies available and the fact that they quickly become outdated, there is confusion about the definitions of the different XR modalities and their unique capabilities. This lack of knowledge, combined with limited faculty time and lack of financial resources, can make it overwhelming for educators to choose the right XR modality to accomplish particular educational objectives. There is a lack of guidance in the literature for AEC educators to consider various factors that affect the success of an XR intervention. Grounded in a comprehensive literature review and the educational framework of the Model of Domain Learning, this paper proposes a decision-making framework to help AEC educators select the appropriate technologies, platforms, and devices to use for various educational outcomes (e.g., learning, interest generation, engagement) considering factors such as budget, scalability, space/equipment needs, and the potential benefits and limitations of each XR modality. To this end, a comprehensive review of the literature was performed to decipher various definitions of XR modalities and how they have been previously utilized in AEC Education. The framework was then successfully validated at a summer camp in the School of Building Construction at Georgia Institute of Technology, highlighting the importance of using appropriate XR technologies depending on the educational context.more » « less
An official website of the United States government

