skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Survey of Annotations in Extended Reality Systems
Annotation in 3D user interfaces such as Augmented Reality (AR) and Virtual Reality (VR) is a challenging and promising area; however, there are not currently surveys reviewing these contributions. In order to provide a survey of annotations for Extended Reality (XR) environments, we conducted a structured literature review of papers that used annotation in their AR/VR systems from the period between 2001 and 2021. Our literature review process consists of several filtering steps which resulted in 103 XR publications with a focus on annotation. We classified these papers based on the display technologies, input devices, annotation types, target object under annotation, collaboration type, modalities, and collaborative technologies. A survey of annotation in XR is an invaluable resource for researchers and newcomers. Finally, we provide a database of the collected information for each reviewed paper. This information includes applications, the display technologies and its annotator, input devices, modalities, annotation types, interaction techniques, collaboration types, and tasks for each paper. This database provides a rapid access to collected data and gives users the ability to search or filter the required information. This survey provides a starting point for anyone interested in researching annotation in XR environments.  more » « less
Award ID(s):
1948254
PAR ID:
10438462
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
IEEE Transactions on Visualization and Computer Graphics
ISSN:
1077-2626
Page Range / eLocation ID:
1 to 20
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The educational applications of extended reality (XR) modalities, including virtual reality (VR), augmented reality (AR), and mixed reality (MR), have increased significantly over the last ten years. Many educators within the Architecture, Engineering, and Construction (AEC) related degree programs see student benefits that could be derived from bringing these modalities into classrooms, which include but are not limited to: a better understanding of each of the subdisciplines and the coordination necessary between them, visualizing oneself as a professional in AEC, and visualization of difficult concepts to increase engagement, self-efficacy, and learning. These benefits, in turn, help recruitment and retention efforts for these degree programs. However, given the number of technologies available and the fact that they quickly become outdated, there is confusion about the definitions of the different XR modalities and their unique capabilities. This lack of knowledge, combined with limited faculty time and lack of financial resources, can make it overwhelming for educators to choose the right XR modality to accomplish particular educational objectives. There is a lack of guidance in the literature for AEC educators to consider various factors that affect the success of an XR intervention. Grounded in a comprehensive literature review and the educational framework of the Model of Domain Learning, this paper proposes a decision-making framework to help AEC educators select the appropriate technologies, platforms, and devices to use for various educational outcomes (e.g., learning, interest generation, engagement) considering factors such as budget, scalability, space/equipment needs, and the potential benefits and limitations of each XR modality. To this end, a comprehensive review of the literature was performed to decipher various definitions of XR modalities and how they have been previously utilized in AEC Education. The framework was then successfully validated at a summer camp in the School of Building Construction at Georgia Institute of Technology, highlighting the importance of using appropriate XR technologies depending on the educational context. 
    more » « less
  2. Extended reality (XR) technologies are becoming increasingly pervasive, and may have capacity to help marginalized groups such as transgender people. Drawing from interviews with n = 18 creators of trans technology, we examined how XR technologies do and can support trans people. We uncovered a number of creative ways that XR technologies support trans experiences. Trans technology creators are designing augmented reality (AR) and virtual reality (VR) systems that help people explore trans identity, experience new types of bodies, educate about and display trans stories and curated trans content, manipulate the physical world, and innovate gender-affirming surgical techniques. Additionally, we show how considering XR as an analogy for trans identity helps us to think about the fluidity and fluctuation inherent in trans identity in new ways, which in turn enables envisioning technologies that can better support complex and changing identities. Despite XR’s potential for supporting trans people, current AR and VR systems face limitations that restrict their large-scale use, but as access to XR systems increase, so will their capacity to improve trans lives. 
    more » « less
  3. Given the inherent visual affordances of Head-Mounted Displays (HMDs) used for Virtual and Augmented Reality (VR/AR), they have been actively used over many years as assistive and therapeutic devices for the people who are visually impaired. In this paper, we report on a scoping review of literature describing the use of HMDs in these areas. Our high-level objectives included detailed reviews and quantitative analyses of the literature, and the development of insights related to emerging trends and future research directions. Our review began with a pool of 1251 papers collected through a variety of mechanisms. Through a structured screening process, we identified 61 English research papers employing HMDs to enhance the visual sense of people with visual impairments for more detailed analyses. Our analyses reveal that there is an increasing amount of HMD-based research on visual assistance and therapy, and there are trends in the approaches associated with the research objectives. For example, AR is most often used for visual assistive purposes, whereas VR is used for therapeutic purposes. We report on eight existing survey papers, and present detailed analyses of the 61 research papers, looking at the mitigation objectives of the researchers (assistive versus therapeutic), the approaches used, the types of HMDs, the targeted visual conditions, and the inclusion of user studies. In addition to our detailed reviews and analyses of the various characteristics, we present observations related to apparent emerging trends and future research directions. 
    more » « less
  4. Advancements in computer technology have revolutionized extended reality (XR) experiences, including augmented reality (AR), virtual reality (VR), mixed reality (MR), and 360° photography and videography. These technologies have found widespread adoption in various educational contexts, from K-12 schools to universities. However, community and technical colleges in the United States have been slower to adopt these innovative instructional modalities. This study aims to investigate the factors influencing the adoption of XR technologies at 2-year institutions, guided by the consolidated framework for implementation research (CFIR). A qualitative research approach was applied by interviewing 13 educators from 2-year colleges to identify their perception and the challenges faced while implementing XR-enabled instruction. Limited availability of XR educational content, restricted development opportunities of XR content, limited integration of these technologies with existing learning management systems, resource constraints and training needs of educators are some of the factors that hinder implementation of these technologies at 2-year colleges. 
    more » « less
  5. Recently, the use of extended reality (XR) systems has been on the rise, to tackle various domains such as training, education, safety, etc. With the recent advances in augmented reality (AR), virtual reality (VR) and mixed reality (MR) technologies and ease of availability of high-end, commercially available hardware, the manufacturing industry has seen a rise in the use of advanced XR technologies to train its workforce. While several research publications exist on applications of XR in manufacturing training, a comprehensive review of recent works and applications is lacking to present a clear progress in using such advance technologies. To this end, we present a review of the current state-of-the-art of use of XR technologies in training personnel in the field of manufacturing. First, we put forth the need of XR in manufacturing. We then present several key application domains where XR is being currently applied, notably in maintenance training and in performing assembly task. We also reviewed the applications of XR in other vocational domains and how they can be leveraged in the manufacturing industry. We finally present some current barriers to XR adoption in manufacturing training and highlight the current limitations that should be considered when looking to develop and apply practical applications of XR. 
    more » « less