skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Serious gaze
In this paper I review gaze-based interaction, distinguishing eye movement analysis from synthesis in virtual reality and games for serious applications. My focus is on four forms of gaze-based interaction: diagnostic, active, passive, and expressive. In discussing each, I briefly review seminal results and recent advancements, highlighting outstanding research problems.  more » « less
Award ID(s):
1748380
PAR ID:
10098312
Author(s) / Creator(s):
Date Published:
Journal Name:
2017 9th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games)
Page Range / eLocation ID:
276 to 283
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. With innovations in the field of gaze and eye tracking, a new concentration of research in the area of gaze-tracked systems and user interfaces has formed in the field of Extended Reality (XR). Eye trackers are being used to explore novel forms of spatial human–computer interaction, to understand human attention and behavior, and to test expectations and human responses. In this article, we review gaze interaction and eye tracking research related to XR that has been published since 1985, which includes a total of 215 publications. We outline efforts to apply eye gaze for direct interaction with virtual content and design of attentive interfaces that adapt the presented content based on eye gaze behavior and discuss how eye gaze has been utilized to improve collaboration in XR. We outline trends and novel directions and discuss representative high-impact papers in detail. 
    more » « less
  2. Our subjective visual experiences involve complex interaction between our eyes, our brain, and the surrounding world. It gives us the sense of sight, color, stereopsis, distance, pattern recognition, motor coordination, and more. The increasing ubiquity of gaze-aware technology brings with it the ability to track gaze and pupil measures with varying degrees of fidelity. With this in mind, a review that considers the various gaze measures becomes increasingly relevant, especially considering our ability to make sense of these signals given different spatio-temporal sampling capacities. In this paper, we selectively review prior work on eye movements and pupil measures. We first describe the main oculomotor events studied in the literature, and their characteristics exploited by different measures. Next, we review various eye movement and pupil measures from prior literature. Finally, we discuss our observations based on applications of these measures, the benefits and practical challenges involving these measures, and our recommendations on future eye-tracking research directions. 
    more » « less
  3. With improved portability and affordability, eye tracking devices have facilitated an expanding range of cycling experiments aimed at understanding cycling behavior and potential risks. Given the complexity of cyclists’ visual behavior and gaze measurements, we provide a comprehensive review with three key focuses: 1) the adoption and interpretation of various gaze metrics derived from cycling experiments, 2) a summary of the findings of those experiments, and 3) identifying areas for future research. A systematic review of three databases yielded thirty-five articles that met our inclusion criteria. Our review results show that cycling experiments with eye tracking allow analysis of the viewpoint of the cyclist and reactions to the built environment, road conditions, navigation behavior, and mental workload and/or stress levels. Our review suggests substantial variation in research objectives and the consequent selection of eye-tracking devices, experimental design, and which gaze metrics are used and interpreted. A variety of general gaze metrics and gaze measurements related to Areas of Interest (AOI) are applied to infer cyclists’ mental workload/stress levels and attention allocation respectively. The diversity of gaze metrics reported in the literature makes cross-study comparisons difficult. Areas for future research, especially potential integration with computer vision are also discussed. 
    more » « less
  4. Kasneci, Enkelejda (Ed.)
    Species vary widely in the conspicuousness of their eye morphology and this could influence gaze perception. Eyes with conspicuous morphology can enhance gaze perception while eyes with camouflaged morphology may hinder gaze perception. While evidence suggests that conspicuous eye morphology enhances gaze perception, little is known about how environmental conditions affect this interaction. Thus, we investigated whether environmental light conditions affect gaze perception. Human subjects ( Homo sapiens ) were instructed to find direct-gaze faces within arrays of averted-gaze faces or to find averted-gaze faces within arrays of directed-gaze faces. The faces were displayed under conditions simulating nighttime or daytime conditions. Furthermore, the faces had naturally-colored sclera (white) or modified sclera (same color as the iris). Participants were fastest and most accurate in detecting faces during the daytime and nighttime conditions when the sclera were naturally-colored. Participants were worst at detecting faces with modified sclera during the nighttime conditions. These results suggest that eyes with conspicuous morphology enhance gaze perception during both daytime and nighttime conditions. 
    more » « less
  5. null (Ed.)
    Whereas social visual attention has been examined in computer-mediated (e.g., shared screen) or video-mediated (e.g., FaceTime) interaction, it has yet to be studied in mixed-media interfaces that combine video of the conversant along with other UI elements. We analyzed eye gaze of 37 dyads (74 participants) who were tasked with negotiating the price of a new car (as a buyer and seller) using mixed-media video conferencing under competitive or cooperative negotiation instructions (experimental manipulation). We used multidimensional recurrence quantification analysis to extract spatio-temporal patterns corresponding to mutual gaze (individuals look at each other), joint attention (individuals focus on the same elements of the interface), and gaze aversion (an individual looks at their partner, who is looking elsewhere). Our results indicated that joint attention predicted the sum of points attained by the buyer and seller (i.e., the joint score). In contrast, gaze aversion was associated with faster time to complete the negotiation, but with a lower joint score. Unexpectedly, mutual gaze was highly infrequent and unrelated to the negotiation outcomes and none of the gaze patterns predicted subjective perceptions of the negotiation. There were also no effects of gender composition or negotiation condition on the gaze patterns or negotiation outcomes. Our results suggest that social visual attention may operate differently in mixed-media collaborative interfaces than in face-to-face interaction. As mixed-media collaborative interfaces gain prominence, our work can be leveraged to inform the design of gaze-sensitive user interfaces that support remote negotiations among other tasks. 
    more » « less