skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: How Do Robot Experts Measure the Success of Social Robot Navigation?
We interviewed 8 individuals from industry and academia to better understand how they valued different aspects of social robot navigation. Interviewees were asked to rank the importance of 10 measures commonly used to evaluate social navigation policies. Interviewees were then asked open-ended questions about social navigation, and how they think about evaluating the challenges they face. Our interviews with industry and academic experts in social navigation revealed that avoiding collisions was the only universally important measure. Beyond the safety consideration of avoiding collisions, roboticists have varying priorities regarding social navigation. Given the high priority interviewees placed on safety, we recommend that social navigation approaches should first aim to ensure safety. Once safety is ensured, we recommend that each social navigation algorithm be evaluated using the measures most relevant to the intended application domain.  more » « less
Award ID(s):
1924802
PAR ID:
10507775
Author(s) / Creator(s):
; ;
Publisher / Repository:
ACM
Date Published:
Journal Name:
HRI '24: Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction
ISBN:
9798400703232
Page Range / eLocation ID:
1063 to 1066
Subject(s) / Keyword(s):
Social Robot Navigation Performance Measures Interview
Format(s):
Medium: X
Location:
Boulder CO USA
Sponsoring Org:
National Science Foundation
More Like this
  1. We propose a demonstration of the Social Environment for Autonomous Navigation with Virtual Reality (VR) for advancing research in Human-Robot Interaction. In our demonstration, a user controls a virtual avatar in simulation and performs directed navigation tasks with a mobile robot in a warehouse environment. Our demonstration shows how researchers can leverage the immersive nature of VR to study robot navigation from a user-centered perspective in densely populated environments while avoiding physical safety concerns common with operating robots in the real world. This is important for studying interactions with robots driven by algorithms that are early in their development lifecycle. 
    more » « less
  2. In public spaces shared with humans, ensuring multi-robot systems navigate without collisions while respecting social norms is challenging, particularly with limited communication. Although current robot social navigation techniques leverage advances in reinforcement learning and deep learning, they frequently overlook robot dynamics in simulations, leading to a simulation-to-reality gap. In this paper, we bridge this gap by presenting a new multi-robot social navigation environment crafted using Dec-POSMDP and multi-agent reinforcement learning. Furthermore, we introduce SAMARL: a novel benchmark for cooperative multi-robot social navigation. SAMARL employs a unique spatial-temporal transformer combined with multi-agent reinforcement learning. This approach effectively captures the complex interactions between robots and humans, thus promoting cooperative tendencies in multi-robot systems. Our extensive experiments reveal that SAMARL outperforms existing baseline and ablation models in our designed environment. Demo videos for this work can be found at: https://sites.google.com/view/samarl 
    more » « less
  3. COVID-19 resulted in health and logistical challenges for many sectors of the American economy, including the trucking industry. This study examined how the pandemic impacted the trucking industry, focused on the pandemic’s impacts on company operations, health, and stress of trucking industry employees. Data were collected from three sources: surveys, focus groups, and social media posts. Individuals at multiple organizational levels of trucking companies (i.e., supervisors, upper-level management, and drivers) completed an online survey and participated in online focus groups. Data from focus groups were coded using a thematic analysis approach. Publicly available social media posts from Twitter were analyzed using a sentiment analysis framework to assess changes in public sentiment about the trucking industry pre- and during-COVID-19. Two themes emerged from the focus groups: (1) trucking company business strategies and adaptations and (2) truck driver experiences and workplace safety. Participants reported supply chain disruptions and new consumer buying trends as having larger industry-wide impacts. Company adaptability emerged due to freight variability, leading organizations to pivot business models and create solutions to reduce operational costs. Companies responded to COVID-19 by accommodating employees’ concerns and implementing safety measures. Truck drivers noted an increase in positive public perception of truck drivers, but job quality factors worsened due to closed amenities and decreased social interaction. Social media sentiment analysis also illustrated an increase in positive public sentiment towards the trucking industry during COVID-19. The pandemic resulted in multi-level economic, health, and social impacts on the trucking industry, which included economic impacts on companies and economic, social and health impacts on employees within the industry levels. Further research can expand on this study to provide an understanding of the long-term impacts of the pandemic on the trucking industry companies within the industry and segments of the trucking industry workforce. 
    more » « less
  4. In the chemical industry, judgements related to process safety hold the potential to lead to process incidents, such as chemical leaks and mechanical failures that can have severe consequences. Many of these judgements require engineers to juxtapose competing criteria including leadership, production, relationships, safety, spending, and time. For such judgements, numerous factors are at play, including our beliefs about ourselves and our intention to behave a particular way. As part of a larger research project funded through the NSF Research in the Formation of Engineers (RFE) program, we are working to investigate: 1) What do engineering students and practitioners believe about how they approach making judgements?, 2) how do they behave when actually making judgements?, 3) what gap, if any, exists between their beliefs and behavior?, and 4) how do they reconcile any gaps between their beliefs and behaviors? After completion of the first year of the project, we have interviewed fourteen senior chemical engineering students about how they believe they will approach process safety judgements in scenarios where they must juxtapose competing criteria. During our initial analysis to characterize students’ espoused beliefs about their approaches towards making process safety judgements, we identified an emergent finding about how they justify these beliefs. We present this emergent finding by answering the research question: How do undergraduate engineering students justify their beliefs about how they will make judgements in process safety contexts? When we asked students to provide reasoning for the beliefs they conveyed about how they will approach process safety judgements, we found that overwhelmingly, students used their lived experiences in different work settings to justify their beliefs. These lived experiences included engineering co-ops, internships, volunteer, and retail work. This emergent finding suggests that students’ lived experiences may be greatly informing their espoused beliefs about how they will approach process safety judgements. This paper will also briefly discuss implications for process safety educators on how they may incorporate lived experiences, or other ways of knowing, so students may develop more robust beliefs about process safety judgements. 
    more » « less
  5. In the chemical industry, judgements related to process safety hold the potential to lead to process incidents, such as chemical leaks and mechanical failures that can have severe consequences. Many of these judgements require engineers to juxtapose competing criteria including leadership, production, relationships, safety, spending, and time. For such judgements, numerous factors are at play, including our beliefs about ourselves and our intention to behave a particular way. As part of a larger research project funded through the NSF Research in the Formation of Engineers (RFE) program, we are working to investigate: 1) What do engineering students and practitioners believe about how they approach making judgements?, 2) how do they behave when actually making judgements?, 3) what gap, if any, exists between their beliefs and behavior?, and 4) how do they reconcile any gaps between their beliefs and behaviors? After completion of the first year of the project, we have interviewed fourteen senior chemical engineering students about how they believe they will approach process safety judgements in scenarios where they must juxtapose competing criteria. During our initial analysis to characterize students’ espoused beliefs about their approaches towards making process safety judgements, we identified an emergent finding about how they justify these beliefs. We present this emergent finding by answering the research question: How do undergraduate engineering students justify their beliefs about how they will make judgements in process safety contexts? When we asked students to provide reasoning for the beliefs they conveyed about how they will approach process safety judgements, we found that overwhelmingly, students used their lived experiences in different work settings to justify their beliefs. These lived experiences included engineering co-ops, internships, volunteer, and retail work. This emergent finding suggests that students’ lived experiences may be greatly informing their espoused beliefs about how they will approach process safety judgements. This paper will also briefly discuss implications for process safety educators on how they may incorporate lived experiences, or other ways of knowing, so students may develop more robust beliefs about process safety judgements. 
    more » « less