skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: VRoad: gesture-based interaction between pedestrians and automated vehicles in virtual reality
As a third party to both automated and non-automated vehicles, pedestrians are among the most vulnerable participants in traffic. Currently, there is no way for them to communicate their intentions to an automated vehicle (AV). In this work, we explore the interactions between pedestrians and AVs at unmarked crossings. We propose a virtual reality testbed, in which we conducted a pilot study to compare three conditions: crossing a street before a car that (1) does not give information, (2) displays its locomotion, or (3) displays its locomotion and reacts to pedestrians' gestures. Our results show that gestures introduce a new point of failure, which can increase pedestrians' insecurity. However, communicating the vehicle's locomotion supports pedestrians, helping them to make safer decisions.  more » « less
Award ID(s):
1658589
PAR ID:
10142419
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
AutomotiveUI '19: Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings
Page Range / eLocation ID:
399 to 404
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; ; (, MobileHCI 2020 Extended Abstracts)
    null (Ed.)
    Automated vehicles are expected to become a part of the road traffic in the near future. This upcoming change raises concerns on how human road users, e.g., cyclists or pedestrians, would interact with them to ensure safe communication on the road. Previous work focused primarily on the scenario in which a young adult with- out impairments crosses a street in front of an automated vehicle. Several road user groups, such as children, seniors, or people with special needs, in roles of pedestrians and cyclists, are not consid- ered in this scenario. On top of this, cultural differences are rarely considered. To ensure that future traffic is safe and accessible for all citizens, we aim to address inclusive communication between automated vehicles and vulnerable road users. In this workshop, we will discuss and exchange methods, tools, and scenarios applicable for inclusive communication, identify the most relevant research gaps, and connect people for future collaborations. 
    more » « less
  2. ; ; ; ; (, 14th {ACM/IEEE} International Conference on Human-Robot Interaction)
    In previous work, researchers have repeatedly demonstrated that robots' use of deictic gestures enables effective and natural human-robot interaction. However, new technologies such as augmented reality head mounted displays enable environments in which mixed-reality becomes possible, and in such environments, physical gestures become but one category among many different types of mixed reality deictic gestures. In this paper, we present the first experimental exploration of the effectiveness of mixed reality deictic gestures beyond physical gestures. Specifically, we investigate human perception of videos simulating the display of allocentric gestures, in which robots circle their targets in users' fields of view. Our results suggest that this is an effective communication strategy, both in terms of objective accuracy and subjective perception, especially when paired with complex natural language references. 
    more » « less
  3. ; ; ; (, in Proc. 3rd Workshop on Hot Topics in Video Analytics and Intelligent Edges (HotEdgeVideo’21))
    Social distancing can reduce infection rates in respiratory pandemics such as COVID-19, especially in dense urban areas. To assess pedestrians’ compliance with social distancing policies, we use the pilot site of the PAWR COSMOS wireless edge-cloud testbed in New York City to design and evaluate an Automated video-based Social Distancing Analyzer (Auto-SDA) pipeline. Auto-SDA derives pedestrians’ trajectories and measures the duration of close proximity events. It relies on an object detector and a tracker, however, to achieve highly accurate social distancing analysis, we design and incorporate 3 modules into Auto-SDA: (i) a calibration module that converts 2D pixel distances to 3D on-ground distances with less than 10 cm error, (ii) a correction module that identifies pedestrians who were missed or assigned duplicate IDs by the object detectiontracker and rectifies their IDs, and (iii) a group detection module that identifies affiliated pedestrians (i.e., pedestrians who walk together as a social group) and excludes them from the social distancing violation analysis. We applied Auto-SDA to videos recorded at the COSMOS pilot site before the pandemic, soon after the lockdown, and after the vaccines became broadly available, and analyzed the impacts of the social distancing protocols on pedestrians’ behaviors and their evolution. For example, the analysis shows that after the lockdown, less than 55% of the pedestrians violated the social distancing protocols, whereas this percentage increased to 65% after the vaccines became available. Moreover, after the lockdown, 0-20% of the pedestrians were affiliated with a social group, compared to 10-45% once the vaccines became available. Finally, following the lockdown, the density of the pedestrians at the intersection decreased by almost 50%. 
    more » « less
  4. ; ; ; ; (, 2017 IEEE Intelligent Vehicles Symposium (IV))
    This paper is on a pedestrian collision warning and avoidance system for road vehicles based on V2X communication. In cases where the presence and location of a pedestrian or group of pedestrians cannot be determined using line-of-sight sensors like camera, radar and lidar, signals from pedestrians' smartphone apps are used to detect and localize them relative to the road vehicle through the DSRC radio used for V2X communication. A hardware-in-the-loop setup using a validated automated driving vehicle model in the high fidelity vehicle dynamics simulation program Carsim Real Time with Sensors and Traffic is used along with two DSRC modems emulating the vehicle and pedestrian communications in the development and initial experimental testing of this method. The vehicle either stops or, if possible, goes around the pedestrians in a socially acceptable manner. The elastic band method is used to locally modify the vehicle trajectory in real time when pedestrians are detected on the nearby path of the vehicle. The effectiveness of the proposed method is demonstrated using hardware-in-the-loop simulations. 
    more » « less
  5. ; ; ; ; (, Proceedings of the Royal Society B: Biological Sciences)
    Many animals communicate by performing elaborate displays that are incredibly extravagant and wildly bizarre. So, how do these displays evolve? One idea is that innate sensory biases arbitrarily favour the emergence of certain display traits over others, leading to the design of an unusual display. Here, we study how physiological factors associated with signal production influence this process, a topic that has received almost no attention. We focus on a tropical frog, whose males compete for access to females by performing an elaborate waving display. Our results show that sex hormones like testosterone regulate specific display gestures that exploit a highly conserved perceptual system, evolved originally to detect ‘dangerous' stimuli in the environment. Accordingly, testosterone makes certain gestures likely to appear more perilous to rivals during combat. This suggests that hormone action can interact with effects of sensory bias to create an evolutionary optimum that guides how display exaggeration unfolds. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email