An official website of the United States government
Robust pervasive context-aware augmented reality (AR) has the potential to enable a range of applications that support users in reaching their personal and professional goals. In such applications, AR can be used to deliver richer, more immersive, and more timely just in time adaptive interventions (JITAI) than conventional mobile solutions, leading to more effective support of the user. This position paper defines a research agenda centered on improving AR applications' environmental, user, and social context awareness. Specifically, we argue for two key architectural approaches that will allow pushing AR context awareness to the next level: use of wearable and Internet of Things (IoT) devices as additional data streams that complement the data captured by the AR devices, and the development of edge computing-based mechanisms for enriching existing scene understanding and simultaneous localization and mapping (SLAM) algorithms. The paper outlines a collection of specific research directions in the development of such architectures and in the design of next-generation environmental, user, and social context awareness algorithms.
more »
« less
ShareAR: Communication-Efficient Multi-User Mobile Augmented Reality
Augmented reality is an emerging application on mobile devices. However, there is a lack of understanding of the communication requirements and challenges of multi-user AR scenarios. In this position paper, we propose several important research issues that need to be addressed for low-latency, accurate shared AR experiences: (a) Systems tradeoffs of AR communication architectures used today in mobile AR platforms; (b) Understanding AR communication patterns and adapting the AR application layer to dynamically changing network conditions; and (c) Tools and methodologies to evaluate AR quality of experience in real time on mobile devices. We present preliminary measurements of off-the-shelf mobile AR platforms as well as results from our AR system, ShareAR, illustrating performance tradeoffs and indicating promising new research directions.
more »
« less
- PAR ID:
- 10123001
- Date Published:
- Journal Name:
- ACM HotNets
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
In many complex tasks, a remote expert may need to assist a local user or to guide his or her actions in the local user's environment. Existing solutions also allow multiple users to collaborate remotely using high-end Augmented Reality (AR) and Virtual Reality (VR) head-mounted displays (HMD). In this paper, we propose a portable remote collaboration approach, with the integration of AR and VR devices, both running on mobile platforms, to tackle the challenges of existing approaches. The AR mobile platform processes the live video and measures the 3D geometry of the local environment of a local user. The 3D scene is then transited and rendered in the remote side on a mobile VR device, along with a simple and effective user interface, which allows a remote expert to easily manipulate the 3D scene on the VR platform and to guide the local user to complete tasks in the local environment.more » « less
-
Data-intensive applications in diverse domains, including video streaming, gaming, and health monitoring, increasingly require that mobile devices directly share data with each other. However, developing distributed data sharing functionality introduces low-level, brittle, and hard-to-maintain code into the mobile codebase. To reconcile the goals of programming convenience and performance efficiency, we present a novel middleware framework that enhances the Android platform's component model to support seamless and efficient inter-device data sharing. Our framework provides a familiar programming interface that extends the ubiquitous Android Inter-Component Communication (ICC), thus lowering the learning curve. Unlike middleware platforms based on the RPC paradigm, our programming abstractions require that mobile application developers think through and express explicitly data transmission patterns, thus treating latency as a first-class design concern. Our performance evaluation shows that using our framework incurs little performance overhead, comparable to that of custom-built implementations. By providing reusable programming abstractions that preserve component encapsulation, our framework enables Android devices to efficiently share data at the component level, providing powerful building blocks for the development of emerging distributed mobile applications.more » « less
-
This article discusses novel research methods used to examine how Augmented Reality (AR) can be utilized to present “omic” (i.e., genomes, microbiomes, pathogens, allergens) information to non-expert users. While existing research shows the potential of AR as a tool for personal health, methodological challenges pose a barrier to the ways in which AR research can be conducted. There is a growing need for new evaluation methods for AR systems, especially as remote testing becomes increasingly popular. In this article, we present two AR studies adapted for remote research environments in the context of personal health. The first study ( n = 355) is a non-moderated remote study conducted using an AR web application to explore the effect of layering abstracted pathogens and mitigative behaviors on a user, on perceived risk perceptions, negative affect, and behavioral intentions. This study introduces methods that address participant precursor requirements, diversity of platforms for delivering the AR intervention, unsupervised setups, and verification of participation as instructed. The second study ( n = 9) presents the design and moderated remote evaluation of a technology probe, a prototype of a novel AR tool that overlays simulated timely and actionable environmental omic data in participants' living environment, which helps users to contextualize and make sense of the data. Overall, the two studies contribute to the understanding of investigating AR as a tool for health behavior and interventions for remote, at-home, empirical studies.more » « less
-
ABSTRACT As technological advances appear, it is desirable to integrate them into new engineering education teaching methods, aiming to enhance students' comprehension and engagement with complex subjects. Augmented reality (AR) emerges as a promising tool in this effort, offering students opportunities to visualize and conceptualize challenging topics that are otherwise too abstract or difficult to grasp. Within civil engineering curriculums, structural analysis, a junior‐level course forming the foundation of many other courses, poses challenges in visualization and understanding. This paper investigates the development of a mobile AR application intended to improve the conceptual understanding of structural analysis material. This application is designed to overlay schematic representations of structural components (i.e., beams, columns, frames, and trusses) onto images of iconic local campus buildings, allowing students to interactively explore exaggerated deflections and internal and external forces under various loading conditions. By contextualizing structural analysis calculations within familiar settings, the goal is to leverage a sense of relevance and place‐based attachments in students' learning. Furthermore, the paper examines the development process and usability of the AR application, providing insights into its implementation in educational settings. Experimental results, including comparisons with a control group, are analyzed to assess the efficacy of the AR application in improving students' understanding of structural analysis concepts. Furthermore, the paper examines the development process and usability of the AR application, providing insights into its implementation in educational settings. Perspectives from structural analysis faculty members are also discussed, shedding light on the potential benefits and challenges associated with integrating AR technology into engineering education. In addition, the study highlights the value of place‐based learning, wherein students engage with real‐world structures in their immediate environment, fostering deeper connections between theoretical concepts and practical applications. Overall, this research contributes to the growing body of literature on innovative teaching approaches in engineering education and highlights the potential of AR as a valuable tool for enhancing student learning experiences in structural analysis and related disciplines.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3365609.3365867
