skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Friday, July 11 until 2:00 AM ET on Saturday, July 12 due to maintenance. We apologize for the inconvenience.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Automated Task-Time Interventions to Improve Teamwork using Imitation Learning
Effective human-human and human-autonomy teamwork is critical but often challenging to perfect. The challenge is particularly relevant in time-critical domains, such as healthcare and disaster response, where the time pressures can make coordination increasingly difficult to achieve and the consequences of imperfect coordination can be severe. To improve teamwork in these and other domains, we present TIC: an automated intervention approach for improving coordination between team members. Using BTIL, a multi-agent imitation learning algorithm, our approach first learns a generative model of team behavior from past task execution data. Next, it utilizes the learned generative model and team's task objective (shared reward) to algorithmically generate execution-time interventions. We evaluate our approach in synthetic multi-agent teaming scenarios, where team members make decentralized decisions without full observability of the environment. The experiments demonstrate that the automated interventions can successfully improve team performance and shed light on the design of autonomous agents for improving teamwork.  more » « less
Award ID(s):
2205454
PAR ID:
10439543
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
AAMAS '23: Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems
Page Range / eLocation ID:
335-344
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. (, Proceedings of the AAAI Conference on Artificial Intelligence)
    Effective teamwork translates to fewer preventable errors and higher task performance in collaborative tasks. However, in time-critical tasks, successful teamwork becomes highly challenging to attain. In such settings, often, team members have partial observability of their surroundings, incur high cost of communication, and have trouble estimating the state and intent of their teammates. To assist a team in improving teamwork at task time, my doctoral research proposes an automated task-time team intervention system. Grounded in the notion of shared mental models, the system first detects whether the team is on the same page or not. It then generates effective interventions to improve teamwork. Additionally, by leveraging past demonstrations to learn a model of team behavior, this system minimizes the need for domain experts to specify teamwork models and rules. 
    more » « less
  2. (, AAAI Workshop on Plan, Activity, and Intent Recognition)
    Teamwork is a set of interrelated reasoning, actions and behaviors of team members that facilitate common objectives. Teamwork theory and experiments have resulted in a set of states and processes for team effectiveness in both human-human and agent-agent teams. However, human-agent teaming is less well studied because it is so new and involves asymmetry in policy and intent not present in human teams. To optimize team performance in human-agent teaming, it is critical that agents infer human intent and adapt their polices for smooth coordination. Most literature in human-agent teaming builds agents referencing a learned human model. Though these agents are guaranteed to perform well with the learned model, they lay heavy assumptions on human policy such as optimality and consistency, which is unlikely in many real-world scenarios. In this paper, we propose a novel adaptive agent architecture in human-model-free setting on a two-player cooperative game, namely Team Space Fortress (TSF). Previous human-human team research have shown complementary policies in TSF game and diversity in human players’ skill, which encourages us to relax the assumptions on human policy. Therefore, we discard learning human models from human data, and instead use an adaptation strategy on a pre-trained library of exemplar policies composed of RL algorithms or rule-based methods with minimal assumptions of human behavior. The adaptation strategy relies on a novel similarity metric to infer human policy and then selects the most complementary policy in our library to maximize the team performance. The adaptive agent architecture can be deployed in real-time and generalize to any off-the-shelf static agents. We conducted human-agent experiments to evaluate the proposed adaptive agent framework, and demonstrated the suboptimality, diversity, and adaptability of human policies in human-agent teams. 
    more » « less
  3. ; ; (, Proceedings of the AAAI Symposium Series)
    Effective teamwork is crucial in high-stakes domains, yet it is highly challenging to achieve. Team members often must make decisions with limited information and under constraints on communication and time. Recognizing both the value of human coaches as well as the challenges of integrating them into practical settings, we envision AI-based coaching agents to enhance team coordination and performance. This extended abstract introduces AI Coaches and Coordinators, highlights key research questions from both human and AI perspectives that must be addressed to realize them, and summarizes our recent work in developing algorithms and systems to bring AI Coaches and Coordinators to fruition. 
    more » « less
  4. ; ; ; ; ; (, Human Factors: The Journal of the Human Factors and Ergonomics Society)
    Objective This work examines two human–autonomy team (HAT) training approaches that target communication and trust calibration to improve team effectiveness under degraded conditions. Background Human–autonomy teaming presents challenges to teamwork, some of which may be addressed through training. Factors vital to HAT performance include communication and calibrated trust. Method Thirty teams of three, including one confederate acting as an autonomous agent, received either entrainment-based coordination training, trust calibration training, or control training before executing a series of missions operating a simulated remotely piloted aircraft. Automation and autonomy failures simulating degraded conditions were injected during missions, and measures of team communication, trust, and task efficiency were collected. Results Teams receiving coordination training had higher communication anticipation ratios, took photos of targets faster, and overcame more autonomy failures. Although autonomy failures were introduced in all conditions, teams receiving the calibration training reported that their overall trust in the agent was more robust over time. However, they did not perform better than the control condition. Conclusions Training based on entrainment of communications, wherein introduction of timely information exchange through one team member has lasting effects throughout the team, was positively associated with improvements in HAT communications and performance under degraded conditions. Training that emphasized the shortcomings of the autonomous agent appeared to calibrate expectations and maintain trust. Applications Team training that includes an autonomous agent that models effective information exchange may positively impact team communication and coordination. Training that emphasizes the limitations of an autonomous agent may help calibrate trust. 
    more » « less
  5. ; ; (, Journal of Intelligence)
    Researchers of team behavior have long been interested in the essential components of effective teamwork. Much existing research focuses on examining correlations between team member traits, team processes, and team outcomes, such as collective intelligence or team performance. However, these approaches are insufficient for providing insight into the dynamic, causal mechanisms through which the components of teamwork interact with one another and impact the emergence of team outcomes. Advances in the field of animal behavior have enabled a precise understanding of the behavioral mechanisms that enable groups to perform feats that surpass the capabilities of the individuals that comprise them. In this manuscript, we highlight how studies of animal swarm intelligence can inform research on collective intelligence in human teams. By improving the ability to obtain precise, time-varying measurements of team behaviors and outcomes and building upon approaches used in studies of swarm intelligence to analyze and model individual and group-level behaviors, researchers can gain insight into the mechanisms underlying the emergence of collective intelligence. Such understanding could inspire targeted interventions to improve team effectiveness and support the development of a comparative framework of group-level intelligence in animal and human groups. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email