An official website of the United States government
Annotation in 3D user interfaces such as Augmented Reality (AR) and Virtual Reality (VR) is a challenging and promising area; however, there are not currently surveys reviewing these contributions. In order to provide a survey of annotations for Extended Reality (XR) environments, we conducted a structured literature review of papers that used annotation in their AR/VR systems from the period between 2001 and 2021. Our literature review process consists of several filtering steps which resulted in 103 XR publications with a focus on annotation. We classified these papers based on the display technologies, input devices, annotation types, target object under annotation, collaboration type, modalities, and collaborative technologies. A survey of annotation in XR is an invaluable resource for researchers and newcomers. Finally, we provide a database of the collected information for each reviewed paper. This information includes applications, the display technologies and its annotator, input devices, modalities, annotation types, interaction techniques, collaboration types, and tasks for each paper. This database provides a rapid access to collected data and gives users the ability to search or filter the required information. This survey provides a starting point for anyone interested in researching annotation in XR environments.
more »
« less
This content will become publicly available on August 8, 2026
It Is Only Eco-Logical: Direct Perception for XR Research
Direct perception, as part of the ecological approach to perception, defines a relationship between an organism and their environment that is specified by lawful information. Researchers can apply the ecological approach to eXtended Reality (XR) work to obtain a richer understanding of users’ perception-action coordination in novel virtual settings. To encourage widespread adoption of this theoretical framework, this methodological paper introduces four major concepts from the ecological approach that are highly relevant to XR applications. We also provide an overview of existing literature to illustrate how those concepts may be used to inform and test their designs. These elements include the study of calibration and attunement, affordances, action based responses, and intrinsic scaling for measurements. The goal of this work is to increase awareness of the value of the ecological approach, and to provide a practical, evidence-based reference for researchers interested in applying these techniques in XR research.
more »
« less
- Award ID(s):
- 2007435
- PAR ID:
- 10621227
- Publisher / Repository:
- ACM
- Date Published:
- ISBN:
- 9798400719578
- Page Range / eLocation ID:
- 1-10
- Subject(s) / Keyword(s):
- Perception Ecological Psychology Theory Affordance eXtended Reality (XR)
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Advancements in computer technology have revolutionized extended reality (XR) experiences, including augmented reality (AR), virtual reality (VR), mixed reality (MR), and 360° photography and videography. These technologies have found widespread adoption in various educational contexts, from K-12 schools to universities. However, community and technical colleges in the United States have been slower to adopt these innovative instructional modalities. This study aims to investigate the factors influencing the adoption of XR technologies at 2-year institutions, guided by the consolidated framework for implementation research (CFIR). A qualitative research approach was applied by interviewing 13 educators from 2-year colleges to identify their perception and the challenges faced while implementing XR-enabled instruction. Limited availability of XR educational content, restricted development opportunities of XR content, limited integration of these technologies with existing learning management systems, resource constraints and training needs of educators are some of the factors that hinder implementation of these technologies at 2-year colleges.more » « less
-
High-spatial-resolution wearable tactile arrays have drawn interest from both industry and research, thanks to their capacity for delivering detailed tactile sensations. However, investigations of human tactile perception with high resolution tactile displays remain limited, primarily due to the high costs of multi-channel control systems and the complex fabrication required for fingertip-sized actuators. In this work, we introduce the Soft Haptic Display (SHD) toolkit, designed to enable students and researchers from diverse technical backgrounds to explore high-density tactile feedback in extended reality (XR), robotic teleoperation, braille displays, navigation aid, MR-compatible somatosensory stimulation, and remote palpation. The toolkit provides a rapid prototyping approach and real-time wireless control for a low-cost, 4×4 soft wearable fingertip tactile display with a spatial resolution of 4 mm. We characterized the display’s performance with a maximum vertical displacement of 1.8 mm, a rise time of 0.25 second, and a maximum refresh rate of 8 Hz. All materials and code are open-sourced to foster broader human tactile perception research of high-resolution haptic displays.more » « less
-
Abstract Promoting people-nature relationships is essential for the effective adoption of Nature-Based Solutions (NBS) in cities. Across scientific domains, the potential of eXtended Reality (XR) technologies as a novel tool to support and enable people-nature relationships is increasingly highlighted. However, the application of XR in urban NBS planning remains uncertain. Through a scoping review of the literature, we found five major application areas for employing XR in the context of people-nature relationships: perception and preference assessment, spatial planning and design, education and awareness enhancement, psychological intervention, and monitoring and maintenance. In this paper, we examine how nature’s instrumental, relational, and intrinsic values are communicated through XR and explore the potential role that XR technologies can play in promoting people-nature relationships. Furthermore, we discuss the implications of adopting XR technologies for urban NBS planning.more » « less
-
Effective communication is crucial for the success of academic projects, especially within multidisciplinary teams where researchers come from different backgrounds not only on personal and/or cultural level but also from different disciplines. This can lead to misunderstandings which might not be even obvious in meetings and project plans if the same terms might be used for different concepts. Team members implicitly assume that all parties work with the same definition of terms. The project VisDict addresses the communication between workflow providers and domain researchers via the creation of a visual dictionary in a science gateway so that differences in the perception of terms are easily recognized and can be timely resolved. Dictionaries are used as translation tools between natural languages – the approach for translating from computational science to research domains such as physics and biology is novel. In this paper, we go into detail for our approach to build a dictionary in a science gateway, the lessons learned from carefully curating the first entries, and plans for automating its extension to a large set of relevant terms including their illustrations.more » « less
