skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: MGpi: A Computational Model of Multiagent Group Perception and Interaction
Toward enabling next-generation robots capable of socially intelligent interaction with humans, we present a computational model of interactions in a social environment of multiple agents and multiple groups. The Multiagent Group Perception and Interaction (MGpi) network is a deep neural network that predicts the appropriate social action to execute in a group conversation (e.g., speak, listen, respond, leave), taking into account neighbors' observable features (e.g., location of people, gaze orientation, distraction, etc.). A central component of MGpi is the Kinesic-Proxemic-Message (KPM) gate, that performs social signal gating to extract important information from a group conversation. In particular, KPM gate filters incoming social cues from nearby agents by observing their body gestures (kinesics) and spatial behavior (proxemics). The MGpi network and its KPM gate are learned via imitation learning, using demonstrations from our designed social interaction simulator. Further, we demonstrate the efficacy of the KPM gate as a social attention mechanism, achieving state-of-the-art performance on the task of group identification without using explicit group annotations, layout assumptions, or manually chosen parameters.  more » « less
Award ID(s):
1637927
PAR ID:
10308753
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
AAMAS '20: Proceedings of the 19th International Conference on Autonomous Agents and MultiAgent Systems
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; (, ACM)
    We present a database for automatic understanding of Social Engagement in MultiParty Interaction (SEMPI). Social engagement is an important social signal characterizing the level of participation of an interlocutor in a conversation. Social engagement involves maintaining attention and establishing connection and rapport. Machine understanding of social engagement can enable an autonomous agent to better understand the state of human participation and involvement to select optimal actions in human-machine social interaction. Recently, video-mediated interaction platforms, e.g., Zoom, have become very popular. The ease of use and increased accessibility of video calls have made them a preferred medium for multiparty conversations, including support groups and group therapy sessions. To create this dataset, we first collected a set of publicly available video calls posted on YouTube. We then segmented the videos by speech turn and cropped the videos to generate single-participant videos. We developed a questionnaire for assessing the level of social engagement by listeners in a conversation probing the relevant nonverbal behaviors for social engagement, including back-channeling, gaze, and expressions. We used Prolific, a crowd-sourcing platform, to annotate 3,505 videos of 76 listeners by three people, reaching a moderate to high inter-rater agreement of 0.693. This resulted in a database with aggregated engagement scores from the annotators. We developed a baseline multimodal pipeline using the state-of-the-art pre-trained models to track the level of engagement achieving the CCC score of 0.454. The results demonstrate the utility of the database for future applications in video-mediated human-machine interaction and human-human social skill assessment. Our dataset and code are available at https://github.com/ihp-lab/SEMPI. 
    more » « less
  2. ; (, Proceedings of the ACM on Human-Computer Interaction)
    Despite increasing awareness and research about online strategic information operations, there remain gaps in our understanding, including how information operations leverage the wider information ecosystem and take shape on and across multiple social media platforms. In this paper we use mixed methods, including digital trace ethnography, to look beyond a single social media platform to the broader information ecosystem. We aim to understand how multiple social media platforms are used, in parallel and complementary ways, to achieve the strategic goals of online information operations. We focus on a specific case study: the contested online conversation surrounding Syria Civil Defense (the White Helmets), a group of first responders that assists civilians affected by the civil war within the country. Our findings reveal a network of social media platforms from which content is produced, stored, and integrated into the Twitter conversation. We highlight specific activities that sustain the strategic narratives and attempt to influence the media agenda. And we note that underpinning these efforts is the work of resilience-building: the use of alternative (non-mainstream) platforms to counter perceived threats of 'censorship' by large, established social media platforms. We end by discussing the implications on social media platform policy. 
    more » « less
  3. (, AERA open)
    Internships are widely viewed as “door openers” to opportunity, yet students without ample financial, social, and institutional supports are often excluded from these experiences. This exclusion is especially problematic for Latinx students attending Hispanic-Serving Institutions, for whom an internship could be transformative. In this article, we elaborate upon Núñez’s (2014) multilevel model of intersectionality to highlight how agents’ perceptions, social categories, embodied practices, and broader contextual forces interrelate to shape Latinx students’ access to internship opportunities at a university in the border region of Texas. Using inductive thematic, correlational, and social-network analysis techniques to analyze survey (n = 192) and focus group (n = 12) data, we find that gender, academic major, socioeconomic status, and race intersect with organizational (e.g., insufficient information) and contextual (e.g., labor markets) factors to shape students’ access and perceptions. We provide recommendations for disrupting systemic inequalities in internship access and culturally appropriate programming and ideas for future research. 
    more » « less
  4. ; ; (, Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction)
    null (Ed.)
    Robots' spatial positioning is a useful communication modality in social interactions. For example, in the context of group conversations, certain types of positioning signal membership to the group interaction. How does robot embodiment influence these perceptions? To investigate this question, we conducted an online study in which participants observed renderings of several robots in a social environment, and judged whether the robots were positioned to take part in a group conversation with other humans in the scene. Our results suggest that robot embodiment can influence perceptions of conversational group membership. An important factor to consider in this regard is whether robot embodiment leads to a discernible orientation for the agent. 
    more » « less
  5. ; ; (, BMC Public Health)
    Abstract BackgroundBeing socially excluded has detrimental effects, with prolonged exclusion linked to loneliness and social isolation. Social disconnection interventions that do not require direct support actions (e.g., “how can I help?”) offer promise in mitigating the affective and cognitive consequences of social exclusion. We examine how various social disconnection interventions involving friends and unknown peers might mitigate social exclusion by buffering (interveningbefore) and by promoting recovery (interveningafter). MethodsWe present an integrative data analysis (IDA) of five studies (N = 664) that systematically exposed participants to exclusion (vs. inclusion) social dynamics. Using a well-validated paradigm, participants had a virtual interaction with two other people. Unbeknownst to participants, the other people’s behavior was programmed to either behave inclusively toward the participant or for one to behave exclusively. Critically, our social disconnection interventions experimentally manipulated whether a friend was present (vs. an unknown peer vs. being alone), the nature of interpersonal engagement (having a face-to-face conversation vs. a reminder of an upcoming interaction vs. mere presence), and the timing of the intervention in relation to the social dynamic (before vs. during vs. after). We then assessed participants’ in-the-moment affective and cognitive responses, which included mood, feelings of belonging, sense of control, and social comfort. ResultsExperiencing exclusion (vs. inclusion) led to negative affective and cognitive consequences. However, engaging in a face-to-face conversation with a friendbeforethe exclusion lessened its impact (p < .001). Moreover, a face-to-face conversation with a friendafterexclusion, and even a reminder of an upcoming interaction with a friend, sped-up recovery (ps < .001). There was less conclusive evidence that a face-to-face conversation with an unknown peer, or that the mere presence of a friend or unknown peer, conferred protective benefits. ConclusionsThe findings provide support for the effectiveness of social disconnection interventions that involve actual (i.e., face-to-face) or symbolic (i.e., reminders) interactions with friends. These interventions target momentary vulnerabilities that arise from social exclusion by addressing negative affect and cognitions before or after they emerge. As such, they offer a promising approach to primary prevention prior to the onset of loneliness and social isolation. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email