skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: As go the feet...: on the estimation of attentional focus from stance
The estimation of the direction of visual attention is critical to a large number of interactive systems. This paper investigates the cross-modal relation of the position of one's feet (or standing stance) to the focus of gaze. The intuition is that while one CAN have a range of attentional foci from a particular stance, one may be MORE LIKELY to look in specific directions given an approach vector and stance. We posit that the cross-modal relationship is constrained by biomechanics and personal style. We define a stance vector that models the approach direction before stopping and the pose of a subject's feet. We present a study where the subjects' feet and approach vector are tracked. The subjects read aloud contents of note cards in 4 locations. The order of `visits' to the cards were randomized. Ten subjects read 40 lines of text each, yielding 400 stance vectors and gaze directions. We divided our data into 4 sets of 300 training and 100 test vectors and trained a neural net to estimate the gaze direction given the stance vector. Our results show that 31% our gaze orientation estimates were within 5°, 51% of our estimates were within 10°, and 60% were within 15°. Given the ability to track foot position, the procedure is minimally invasive.  more » « less
Award ID(s):
0756058
PAR ID:
10046371
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
ACM Trans Comput Hum Interaction
Page Range / eLocation ID:
97
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; (, PLOS ONE)
    Zhang, Lei (Ed.)
    When humans navigate through complex environments, they coordinate gaze and steering to sample the visual information needed to guide movement. Gaze and steering behavior have been extensively studied in the context of automobile driving along a winding road, leading to accounts of movement along well-defined paths over flat, obstacle-free surfaces. However, humans are also capable of visually guiding self-motion in environments that are cluttered with obstacles and lack an explicit path. An extreme example of such behavior occurs during first-person view drone racing, in which pilots maneuver at high speeds through a dense forest. In this study, we explored the gaze and steering behavior of skilled drone pilots. Subjects guided a simulated quadcopter along a racecourse embedded within a custom-designed forest-like virtual environment. The environment was viewed through a head-mounted display equipped with an eye tracker to record gaze behavior. In two experiments, subjects performed the task in multiple conditions that varied in terms of the presence of obstacles (trees), waypoints (hoops to fly through), and a path to follow. Subjects often looked in the general direction of things that they wanted to steer toward, but gaze fell on nearby objects and surfaces more often than on the actual path or hoops. Nevertheless, subjects were able to perform the task successfully, steering at high speeds while remaining on the path, passing through hoops, and avoiding collisions. In conditions that contained hoops, subjects adapted how they approached the most immediate hoop in anticipation of the position of the subsequent hoop. Taken together, these findings challenge existing models of steering that assume that steering is tightly coupled to where actors look. We consider the study’s broader implications as well as limitations, including the focus on a small sample of highly skilled subjects and inherent noise in measurement of gaze direction. 
    more » « less
  2. ; (, ACM Symposium on Eye Tracking Research and Applications)
    null (Ed.)
    Texture-based features computed on eye movement scan paths have recently been proposed for eye movement biometric applications. Feature vectors were extracted within this prior work by computing the mean and standard deviation of the resulting images obtained through application of a Gabor filter bank. This paper describes preliminary work exploring an alternative technique for extracting features from Gabor filtered scan path images. Namely, features vectors are obtained by downsampling the filtered images, thereby retaining structured spatial information within the feature vector. The proposed technique is validated at various downsampling scales for data collected from 94 subjects during free-viewing of a fantasy movie trailer. The approach is demonstrated to reduce EER versus the previously proposed statistical summary technique by 11.7% for the best evaluated downsampling parameter. 
    more » « less
  3. ; ; ; ; ; ; (, Proceedings of the ACM on Computer Graphics and Interactive Techniques)
    Gaze-annotated facial data is crucial for training deep neural networks (DNNs) for gaze estimation. However, obtaining these data is labor-intensive and requires specialized equipment due to the challenge of accurately annotating the gaze direction of a subject. In this work, we present a generative framework to create annotated gaze data by leveraging the benefits of labeled and unlabeled data sources. We propose a Gaze-aware Compositional GAN that learns to generate annotated facial images from a limited labeled dataset. Then we transfer this model to an unlabeled data domain to take advantage of the diversity it provides. Experiments demonstrate our approach's effectiveness in generating within-domain image augmentations in the ETH-XGaze dataset and cross-domain augmentations in the CelebAMask-HQ dataset domain for gaze estimation DNN training. We also show additional applications of our work, which include facial image editing and gaze redirection. 
    more » « less
  4. ; ; (, Proceedings of the Physics Education Research Conference 2023)
    Jones, D; Ryan, Q; Pawl, A (Ed.)
    An understanding of vectors and vector operations is crucial for success in physics, as this serves as the foundation for various essential concepts, including motion and forces. Previous research indicates that only a fraction of introductory physics students have a usable knowledge of vectors and vector operations, and that more attention should be given to how students make sense of vectors. We examined classroom video data from an introductory physics course wherein students worked collaboratively through learning activities to introduce vectors and vector operations. During these activities, students’ employment of gesture as a representational mode facilitated group sense-making. We propose a preliminary taxonomy of gestures for representing vector magnitudes, directions, and initial and terminal points. By identifying and characterizing the gestures used by students, we can gain insights into their learning processes and conceptual understanding of vectors, which can inform instructional design and teaching practices. 
    more » « less
  5. ; ; (, PLOS ONE)
    Kasneci, Enkelejda (Ed.)
    Species vary widely in the conspicuousness of their eye morphology and this could influence gaze perception. Eyes with conspicuous morphology can enhance gaze perception while eyes with camouflaged morphology may hinder gaze perception. While evidence suggests that conspicuous eye morphology enhances gaze perception, little is known about how environmental conditions affect this interaction. Thus, we investigated whether environmental light conditions affect gaze perception. Human subjects ( Homo sapiens ) were instructed to find direct-gaze faces within arrays of averted-gaze faces or to find averted-gaze faces within arrays of directed-gaze faces. The faces were displayed under conditions simulating nighttime or daytime conditions. Furthermore, the faces had naturally-colored sclera (white) or modified sclera (same color as the iris). Participants were fastest and most accurate in detecting faces during the daytime and nighttime conditions when the sclera were naturally-colored. Participants were worst at detecting faces with modified sclera during the nighttime conditions. These results suggest that eyes with conspicuous morphology enhance gaze perception during both daytime and nighttime conditions. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email