Attention:The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Thursday, October 15th until 12:00 AM ET on Friday, October 16th due to maintenance. We apologize for the inconvenience.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • “I See You!”: A Design Framework for Interface Cues about Agent Visual Perception from a Thematic Analysis of Videogames
Title: “I See You!”: A Design Framework for Interface Cues about Agent Visual Perception from a Thematic Analysis of Videogames
As artificial agents proliferate, there will be more and more situations in which they must communicate their capabilities to humans, including what they can “see.” Artificial agents have existed for decades in the form of computer-controlled agents in videogames. We analyze videogames in order to not only inspire the design of better agents, but to stop agent designers from replicating research that has already been theorized, designed, and tested in-depth. We present a qualitative thematic analysis of sight cues in videogames and develop a framework to support human-agent interaction design. The framework identifies the different locations and stimulus types – both visualizations and sonifications – available to designers and the types of information they can convey as sight cues. Insights from several other cue properties are also presented. We close with suggestions for implementing such cues with existing technologies to improve the safety, privacy, and efficiency of human-agent interactions.  more » « less
Award ID(s):
2106402 2105069 1651532 2106380
PAR ID:
10329132
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
ACM
Date Published:
Journal Name:
CHI '22: CHI Conference on Human Factors in Computing Systems
Page Range / eLocation ID:
1 to 22
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; (, AI Magazine)
    This paper discusses the perspective that managing the configuration of a network of human and software agents is a form of distributed work that should be explicitly considered when designing human‐agent systems. We describe a configuration of human and software agents as the organization of their roles and relationships that shape and constrain their joint activity while responding to a dynamic flow of events. The paper argues that design for safe and effective teamwork must consider how human and software roles together manage, change, and coordinate their collective configuration over time to respond to changing work demands. We illustrate this form of distributed work at multiple layers of abstraction of a human‐agent system, describing how maintaining goal alignment, tracking and managing interdependencies, synchronizing multi‐threaded activities, and managing the structural topology all involve deliberate and continuous effort. In the second half of the paper, we connect these ideas to modeling approaches for supporting conceptual design of human‐agent systems. The paper discusses how functional modeling of work can help designers first envision the coordinative structures necessary for adaptation before specifying the technical details of how individual tasks are executed (a whole‐to‐parts and coordination‐first approach). We illustrate a specific modeling framework, currently under development, that aims to facilitate the envisioning of the work of configuration management and help designers identify competencies and coordinative structures to support it. We provide an initial discussion of a three‐phase “bootstrapping” approach for using this framework in human‐agent system design. This paper contributes a new direction for explicitly modeling and designing for reconfiguration in human‐agent systems. Future work is needed to further develop the tooling and techniques, evaluate and validate their ability to inform human‐agent system design, and ultimately create more resilient human‐agent systems. 
    more » « less
  2. (, Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’19).)
    This paper presents the rationale and current progress of my Ph.D. dissertation: "design interactions between robot surfaces and human designers." This specific topic serves as a case study trying to explore the question of how to design an interactive and partially intelligent space. We proposed the concept of "space agent" defined as "interactive and intelligent environments perceived by users as human agents" based on communication theories. Built upon this concept, we proposed a design framework for interactive environments. Then we further explored literatures about what space agent could contribute to human users specifically for the case of interior designers' work space. Research questions and research designs are introduced in this paper, followed by the discussions of experiments design. 
    more » « less
  3. ; ; (, Proceedings of the ACM on Human-Computer Interaction)
    At times, the interfaces of videogames -- gameworlds -- contain tiny details that go unnoticed. One such detail is how designers employ ! and ? to communicate to players. These punctuation marks have existed in videogames since their creation, yet remain undiscussed by designers. They are used as ways to promote curiosity, as objects, as ways to symbolize excitement, and as a prompt to react. Their varied history is deserving of attention, so we present a chronicle of two pieces of gameworld punctuation: ! and ?. We discuss current and past uses and identify more ways that these could be used in the future. These symbols may present a useful space of inquiry not only for games and games research, but more generally, in terms of the rapid communication of complex information. 
    more » « less
  4. ; ; (, CHIPlay)
    At times, the interfaces of videogames – gameworlds – contain tiny details that go unnoticed. One such detail is how designers employ ! and ? to communicate to players. These punctuation marks have existed in videogames since their creation, yet remain undiscussed by designers. They are used as ways to promote curiosity, as objects, as ways to symbolize excitement, and as a prompt to react. Their varied history is deserving of attention, so we present a chronicle of two pieces of gameworld punctuation: ! and ?. We discuss current and past uses and identify more ways that these could be used in the future. These symbols may present a useful space of inquiry not only for games and games research, but more generally, in terms of the rapid communication of complex information. 
    more » « less
  5. ; ; ; ; ; ; ; (, ACM)
    In the physical world, teammates develop situation awareness about each other's location, status, and actions through cues such as gaze direction and ambient noise. To support situation awareness, distributed multiplayer games provide awareness cues - information that games automatically make available to players to support cooperative gameplay. The design of awareness cues can be extremely complex, impacting how players experience games and work with teammates. Despite the importance of awareness cues, designers have little beyond experiential knowledge to guide their design. In this work, we describe a design framework for awareness cues, providing insight into what information they provide, how they communicate this information, and how design choices can impact play experience. Our research, based on a grounded theory analysis of current games, is the first to provide a characterization of awareness cues, providing a palette for game designers to improve design practice and a starting point for deeper research into collaborative play. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Text Encoded Conversion
  • XML
  • Save / Share this Record
  • Send to Email