An official website of the United States government
Over the past decade, augmented reality (AR) developers have explored a variety of approaches to allow users to interact with the information displayed on smart glasses and head-mounted displays (HMDs). Current interaction modalities such as mid-air gestures, voice commands, or hand-held controllers provide a limited range of interactions with the virtual content. Additionally, these modalities can also be exhausting, uncomfortable, obtrusive, and socially awkward. There is a need to introduce comfortable interaction techniques for smart glasses and HMDS without the need for visual attention. This paper presents StretchAR, wearable straps that exploit touch and stretch as input modalities to interact with the virtual content displayed on smart glasses. StretchAR straps are thin, lightweight, and can be attached to existing garments to enhance users' interactions in AR. StretchAR straps can withstand strains up to 190% while remaining sensitive to touch inputs. The strap allows the effective combination of these inputs as a mode of interaction with the content displayed through AR widgets, maps, menus, social media, and Internet of Things (IoT) devices. Furthermore, we conducted a user study with 15 participants to determine the potential implications of the use of StretchAR as input modalities when placed on four different body locations (head, chest, forearm, and wrist). This study reveals that StretchAR can be used as an efficient and convenient input modality for smart glasses with a 96% accuracy. Additionally, we provide a collection of 28 interactions enabled by the simultaneous touch-stretch capabilities of StretchAR. Finally, we facilitate recommendation guidelines for the design, fabrication, placement, and possible applications of StretchAR as an interaction modality for AR content displayed on smart glasses.
more »
« less
Negotiating Dyadic Interactions through the Lens of Augmented Reality Glasses
Augmented Reality (AR) glasses separate dyadic interactions on diferent sides of the lens, where the person wearing the glasses (primary user) sees an AR world overlaid on their partner (secondary actor). The secondary actor interacts with the primary user under- standing they are seeing both physical and virtual worlds. We use grounded theory to study interaction tasks, participatory design ses- sions, and in-depth interviews of 10 participants and explore how AR real-time modifcations afect them. We observe a power imbalance attributed to the: (1) lack of transparency of the primary user’s view, (2) violation of agency over self-presentation, and (3) discreet record- ing capabilities of AR glasses. This information asymmetry leads to a negotiation of behaviors to reach a silently understood equilibrium. This paper addresses underlying design issues that contribute to power imbalances in dyadic interactions and ofers nuanced insights into the dynamics between primary users and secondary actors.
more »
« less
- Award ID(s):
- 1901151
- PAR ID:
- 10463861
- Date Published:
- Journal Name:
- Designing Interactive Systems Conference (DIS ’23)
- Page Range / eLocation ID:
- 493 to 508
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Sedentary behavior is prevalent in older adults. Older adults often underutilize public parks for exercising because the parks do not support their needs and preferences. Engaging older adults on the redesign of parks may help promote active lifestyles. The objectives of this pilot study were to evaluate (1) the effects of wearing augmented reality (AR) and virtual reality (VR) glasses on balance; (2) the effects of different virtual walls separating the walking trail from the roadway on older adults’ gait, and (3) the preferences of the participants regarding wall design and other features. The participants were ten older adults (68 ± 5 years) who lived within two miles from the park. Balance and gait were assessed using a force plate and an instrumented mat. It was feasible to use AR with older adults in the park to evaluate features for redesign. Motion sickness was not an issue when using AR glasses, but balance was affected when wearing VR goggles. The area of postural sway increased approximately 25% when wearing AR glasses, and it increased by close to 70% when wearing VR goggles compared to no glasses. This difference is clinically relevant; however, we did not have enough power to identify the differences as statistically significant because of the small sample size and large variability. Different walls did not significantly affect the participants’ gait either because they did not alter the way they walked or because the holograms were insufficiently realistic to cause changes. The participants preferred a transparent wall rather than tall or short solid walls to separate the park from the roadway.more » « less
-
Augmented reality (AR), which overlays virtual content on top of the user’s perception of the real world, has now begun to enter the consumer market. Besides smartphone platforms, early-stage head-mounted displays such as the Microsoft HoloLens are under active development. Many compelling uses of these technologies are multi-user: e.g., inperson collaborative tools, multiplayer gaming, and telepresence. While prior work on AR security and privacy has studied potential risks from AR applications, new risks will also arise among multiple human users. In this work, we explore the challenges that arise in designing secure and private content sharing for multi-user AR. We analyze representative application case studies and systematize design goals for security and functionality that a multi-user AR platform should support. We design an AR content sharing control module that achieves these goals and build a prototype implementation (ShareAR) for the HoloLens. This work builds foundations for secure and private multi-user AR interactions.more » « less
-
Augmented Reality (AR) enables elements of a computer-generated digital world to be integrated with a user’s perception of the physical world. Smart glasses, like smart phones, have independent operating systems and they can support a variety of different applications and modes of communication to support augmented reality. This paper details the development of a novel new application that extends a widely-used mobile app for phenotyping and allows agronomists to interact with the app while keeping their hands free to perform field work. The smart glasses accept voice commands from the user and communicate with the mobile phone app via Bluetooth. In addition, changes detected by the mobile phone are displayed to the user on the smart glasses. This enables agronomists to efficiently collect phenotypic data.more » « less
-
null (Ed.)This paper assesses the feasibility of a novel dynamic spectrum sharing approach for a cellular downlink based on cognitive overlay to allow non-orthogonal cellular transmissions from a primary and a secondary radio access technology concurrently on the same radio resources. The 2-user Gaussian cognitive interference channel is used to model a downlink scenario in which the primary and secondary base stations are co-located. A system architecture is defined that addresses practical challenges associated with cognitive overlay, in particular the noncausal knowledge of the primary user message at the cognitive transmitter. A cognitive overlay scheme is applied that combines superposition coding with dirty paper coding, and a primary user protection criterion is derived that is specific to a scenario in which the primary system is 4G while the secondary system is 5G. Simulation is used to evaluate the achievable signal-to-interference-plus-noise ratio (SINR) at the 4G and 5G receivers, as well as the cognitive power allocation parameter as a function of distance. Results suggest that the cognitive overlay scheme is feasible when the distance to the 5G receiver is relatively small, even when a large majority of the secondary user transmit power is allocated to protecting the primary user transmission. Achievable link distances for the 5G receiver are on the order of hundreds of meters for an urban macrocell or a few kilometers for a rural macrocell.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3563657.3595967
