An official website of the United States government
Extended reality (XR) technologies, such as virtual reality (VR) and augmented reality (AR), provide users, their avatars, and embodied agents a shared platform to collaborate in a spatial context. Although traditional face-to-face communication is limited by users’ proximity, meaning that another human’s non-verbal embodied cues become more difficult to perceive the farther one is away from that person, researchers and practitioners have started to look into ways to accentuate or amplify such embodied cues and signals to counteract the effects of distance with XR technologies. In this article, we describe and evaluate the Big Head technique, in which a human’s head in VR/AR is scaled up relative to their distance from the observer as a mechanism for enhancing the visibility of non-verbal facial cues, such as facial expressions or eye gaze. To better understand and explore this technique, we present two complimentary human-subject experiments in this article. In our first experiment, we conducted a VR study with a head-mounted display to understand the impact of increased or decreased head scales on participants’ ability to perceive facial expressions as well as their sense of comfort and feeling of “uncannniness” over distances of up to 10 m. We explored two different scaling methods and compared perceptual thresholds and user preferences. Our second experiment was performed in an outdoor AR environment with an optical see-through head-mounted display. Participants were asked to estimate facial expressions and eye gaze, and identify a virtual human over large distances of 30, 60, and 90 m. In both experiments, our results show significant differences in minimum, maximum, and ideal head scales for different distances and tasks related to perceiving faces, facial expressions, and eye gaze, and we also found that participants were more comfortable with slightly bigger heads at larger distances. We discuss our findings with respect to the technologies used, and we discuss implications and guidelines for practical applications that aim to leverage XR-enhanced facial cues.
more »
« less
This content will become publicly available on March 21, 2027
Spatial Exploration Behavior in XR Learning: Toward Passive Assessment of Embodied Engagement
Not AvailableExtended Reality (XR) learning environments generate rich behavioral data through embodied interaction—head movements, gaze patterns, and spatial navigation—that could enable passive assessment without interrupting the learning experience. We investigate spatial exploration behavior in ACHIEVE, an XR environment for neural network visualization learning. In a between-subjects study (N = 56), XR participants exhibited significantly different spatial behavior than desktop users: over 14 times greater pointer movement (M = 132.5 m vs. M = 9.5 m), extensive head rotation (M = 9,818◦ ), and M = 22.5 m of head translation during the learning session. We visualize individual exploration patterns through head and pointer trajectory traces, revealing substantial variation in how learners navigate the 3D content. These spatial metrics, automatically captured during learning, represent a promising avenue for passive assessment of embodied engagement—enabling educators to identify struggling learners, provide personalized feedback, and adapt content delivery without intrusive testing. Full learning outcomes and user experience metrics are reported in companion publications; here we focus on spatial behavior as a novel contribution toward spatialized learning analytics in education
more »
« less
- PAR ID:
- 10688221
- Publisher / Repository:
- IEEE
- Date Published:
- ISBN:
- 979-8-3195-0529-3
- Page Range / eLocation ID:
- 241 to 247
- Format(s):
- Medium: X
- Location:
- Daegu, Korea, Republic of
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The Human Factors Extended Reality (XR) Showcase is an annual, interactive hands-on demonstration session of XR technologies and applications. Attendees can walk to different stations to experience the applications while the presenter explains. The 12 interactive demonstration stations highlight the integration of XR technologies and other technologies, including haptic devices and artificial intelligence, to enable human factor research and applications that span training, learning, research assessment, and simulations. Aligned with the mission of HFES, the purpose of the XR Showcase is to enable individuals to acquire knowledge about XR applications through interactive demonstrations, increase exposure of XR to the HFES community, support content visualization of interdisciplinary research, and create an exchange forum to support communication and collaboration.more » « less
-
In time-critical eXtended reality (XR) scenarios where users must rapidly reorient their attention to hazards, alerts, or instructions while engaged in a primary task, spatial audio can provide an immediate directional cue without occupying visual bandwidth. However, such scenarios can afford only a brief auditory exposure, requiring users to interpret sound direction quickly and without extended listening or head-driven refinement. This paper reports a controlled exploratory study of rapid spatial-audio localization in XR. Using HRTF-rendered broadband stimuli presented from a semi-dense set of directions around the listener, we quantify how accurately users can infer coarse direction from brief audio alone. We further examine the effects of short-term visuo-auditory feedback training as a lightweight calibration mechanism. Our findings show that brief spatial cues can convey coarse directional information, and that even short calibration can improve users’ perception of aural signals. While these results highlight the potential of spatial audio for rapid attention guidance, they also show that auditory cues alone may not provide sufficient precision for complex or high-stakes tasks, and that spatial audio may be most effective when complemented by other sensory modalities or visual cues, without relying on head-driven refinement. We leverage this study on spatial audio as a preliminary investigation into a first-stage attention-guidance channel for wearable XR (e.g., VR head-mounted displays and AR smart glasses), and provide design insights on stimulus selection and calibration for time-critical use.more » « less
-
null (Ed.)Purpose Designers of learning experiences are concerned with how people learn across a range of timescales from a semester to a single moment in time. And just as designing experiences at different timescales requires unique goals, tools, and processes, measuring what people learn from their interactions is also timescale-specific. The aim of our work is twofold: 1) To understand how learners describe their experiences with short-term, introductory maker experiences and; 2) To test a method for assessing learners’ experiences authentic to short-term learning. Design We collected written responses from participants at a two-day event, STEM Center Learning Days. Through an analysis of 707 unique instances of learner responses to participation in drop-in maker activities, we examined how participants describe their short-term learning experiences. Findings We found that although some activities appear to onlookers to create passive experiences for learners, these seemingly passive moments have a significant impact on learners. In addition, some learners described themselves as working in tandem with tools to make something work and other learners viewed the tools as working autonomously. We found that our assessment method allowed us to gain an understanding of how learners describe their experiences offering important implications for understanding short-term learning events. Originality/ Implications Our findings provide researchers studying short-term learning in its natural setting a new method to understand how learners make sense of their individual experience. Further, designers of short-term learning experiences may gain insights into their unique activities and indications of where additional guidance and scaffolds will improve small learning moments. Keywords Makerspaces, STEM, assessmentmore » « less
-
Social virtual reality platforms present new opportunities for embodied de- sign processes. This paper illustrates a range of embodied design techniques made possible through social engagement with VR/XR technology. Drawing from a case study involving the prototyping of a conversation visualization system for VR meetings, we present several novel embodied design methods in VR (also applicable to XR). These include: new techniques for supporting embodied ideation; new ways of acting out and improvising scenarios together; and new opportunities for preparing and ma- nipulating assets, environments, and low fidelity interactions for embodied design pro- cesses. These novel techniques and approaches point to exciting new opportunities for expanding the repertoire of embodied design practice more broadly.more » « less
