skip to main content


Title: Participatory Design in the Classroom: Exploring the Design of an Autonomous Vehicle Human-Machine Interface with a Visually Impaired Co-Designer
Self-driving vehicles are the latest innovation in improving personal mobility and road safety by removing arguably error-prone humans from driving-related tasks. Such advances can prove especially beneficial for people who are blind or have low vision who cannot legally operate conventional motor vehicles. Missing from the related literature, we argue, are studies that describe strategies for vehicle design for these persons. We present a case study of the participatory design of a prototype for a self-driving vehicle human-machine interface (HMI) for a graduate-level course on inclusive design and accessible technology. We reflect on the process of working alongside a co-designer, a person with a visual disability, to identify user needs, define design ideas, and produce a low-fidelity prototype for the HMI. This paper may benefit researchers interested in using a similar approach for designing accessible autonomous vehicle technology. INTRODUCTION The rise of autonomous vehicles (AVs) may prove to be one of the most significant innovations in personal mobility of the past century. Advances in automated vehicle technology and advanced driver assistance systems (ADAS) specifically, may have a significant impact on road safety and a reduction in vehicle accidents (Brinkley et al., 2017; Dearen, 2018). According to the Department of Transportation (DoT), automated vehicles could help reduce road accidents caused by human error by as much as 94% (SAE International, n.d.). In addition to reducing traffic accidents and saving lives and property, autonomous vehicles may also prove to be of significant value to persons who cannot otherwise operate conventional motor vehicles. AVs may provide the necessary mobility, for instance, to help create new employment opportunities for nearly 40 million Americans with disabilities (Claypool et al., 2017; Guiding Eyes for the Blind, 2019), for instance. Advocates for the visually impaired specifically have expressed how “transformative” this technology can be for those who are blind or have significant low vision (Winter, 2015); persons who cannot otherwise legally operate a motor vehicle. While autonomous vehicles have the potential to break down transportation  more » « less
Award ID(s):
1849924
NSF-PAR ID:
10328666
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
ISSN:
2169-5067
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Zonta, Daniele ; Su, Zhongqing ; Glisic, Branko (Ed.)
    Recent developments in autonomous vehicle (AV) or connected AVs (CAVs) technology have led to predictions that fully self-driven vehicles could completely change the transportation network over the next decades. However, at this stage, AVs and CAVs are still in the development stage which requires various trails in the field and machine learning through autonomous driving miles on real road networks. Until the complete market adoption of autonomous technology, a long transition period of coexistence between conventional and autonomous cars would exist. It is important to study and develop the expected driving behavior of future autonomous cars and the traffic simulation platforms provide an opportunity for researchers and technology developers to implement and assess the different behaviors of self-driving vehicle technology before launching it to the actual ground. This study utilizes PTV VISSIM microsimulation platform to evaluate the mobility performance of unmanned vehicles at a 4-way signalized traffic intersection. The software contains three different AV-ready driving logics such as AV-cautious, AV-normal, and AV-aggressive which were tested against the performance of the conventional vehicles, and the results of the study revealed that the overall network operational performance improves with the progressive introduction of AVs using AV-normal, and AV-aggressive driving behaviors while the AV-cautious driving behavior stays conservative and deteriorates the traffic performance. 
    more » « less
  2. A. Ghate, K. Krishnaiyer (Ed.)
    Deaths due to road traffic accidents are one of the leading causes of death in the United States. Furthermore, the economic impact of road traffic accidents accounts for about 3% of the United States' annual gross domestic product (GDP). In the past decade, extensive research has focused on autonomous vehicles (AVs). This technology is said to help prevent traffic accidents while promoting road traffic safety. This study aims to investigate the safety performance of AVs and identify the significant risk factors associated with the AV collisions. The study considers more than 200 crashes involving AVs and includes vehicle factors, environmental factors, collision type and crash severity. Multinomial logistic regression was conducted with collision type. The results showed no statistically significant risk factors to crash severity. However, movement preceding to collision contributes significantly to collision type. When both vehicles are moving, there's a higher likelihood of an angled collision, 47% to be exact. The other scenario which demonstrates a high probability of an angled collision is when the AV vehicle is not moving while the other is moving. The highest probability for a rear-end collision to occur is when the AV vehicle is not moving while the other is moving. This scenario makes up 55% of the entire rear-end collisions. As for the second-highest proportion, both vehicles moving, it consists of 42%. The research shall help reduce AV involved collisions and increase driving safety. 
    more » « less
  3. Learning the human--mobility interaction (HMI) on interactive scenes (e.g., how a vehicle turns at an intersection in response to traffic lights and other oncoming vehicles) can enhance the safety, efficiency, and resilience of smart mobility systems (e.g., autonomous vehicles) and many other ubiquitous computing applications. Towards the ubiquitous and understandable HMI learning, this paper considers both spoken language (e.g., human textual annotations) and unspoken language (e.g., visual and sensor-based behavioral mobility information related to the HMI scenes) in terms of information modalities from the real-world HMI scenarios. We aim to extract the important but possibly implicit HMI concepts (as the named entities) from the textual annotations (provided by human annotators) through a novel human language and sensor data co-learning design.

    To this end, we propose CG-HMI, a novel Cross-modality Graph fusion approach for extracting important Human-Mobility Interaction concepts from co-learning of textual annotations as well as the visual and behavioral sensor data. In order to fuse both unspoken and spoken languages, we have designed a unified representation called the human--mobility interaction graph (HMIG) for each modality related to the HMI scenes, i.e., textual annotations, visual video frames, and behavioral sensor time-series (e.g., from the on-board or smartphone inertial measurement units). The nodes of the HMIG in these modalities correspond to the textual words (tokenized for ease of processing) related to HMI concepts, the detected traffic participant/environment categories, and the vehicle maneuver behavior types determined from the behavioral sensor time-series. To extract the inter- and intra-modality semantic correspondences and interactions in the HMIG, we have designed a novel graph interaction fusion approach with differentiable pooling-based graph attention. The resulting graph embeddings are then processed to identify and retrieve the HMI concepts within the annotations, which can benefit the downstream human-computer interaction and ubiquitous computing applications. We have developed and implemented CG-HMI into a system prototype, and performed extensive studies upon three real-world HMI datasets (two on car driving and the third one on e-scooter riding). We have corroborated the excellent performance (on average 13.11% higher accuracy than the other baselines in terms of precision, recall, and F1 measure) and effectiveness of CG-HMI in recognizing and extracting the important HMI concepts through cross-modality learning. Our CG-HMI studies also provide real-world implications (e.g., road safety and driving behaviors) about the interactions between the drivers and other traffic participants.

     
    more » « less
  4. Autonomous vehicles (AVs) are closer to becoming a reality in changing the landscape of commercial and personal transportation. The launch of these vehicles come with the promise of improved road safety, reduced traffic fatalities, and enhanced mobility. However, there are questions as to whether the design of AVs will meet the needs of everyone, including people with disabilities and older adults. We argue that there exists no conceptual model that guide sthe inclusive design of autonomous vehicles to benefit all intended users. This paper proposes such a model, called the User Transportation-Activity Technology (UTT) model, which supports the inclusive design of AVs. We present a review of current models of assistive technology design and their drawbacks followed by an introduction of the UTT model and its application in AV design. This paper may benefit researchers, designers, and developers of autonomous vehicles interested in addressing accessible design issues in such vehicles. 
    more » « less
  5. Autonomous vehicles (AVs) are envisioned to enhance safety and efficiency on the road, increase productivity, and positively impact the urban transportation system. Due to recent developments in autonomous driving (AD) technology, AVs have started moving on the road. However, this promising technology has many unique security challenges that have the potential to cause traffic accidents. Though some researchers have exploited and addressed specific security issues in AD, there is a lack of a systematic approach to designing security solutions using a comprehensive threat model. A threat model analyzes and identifies potential threats and vulnerabilities. It also identifies the attacker model and proposes mitigation strategies based on known security solutions. As an emerging cyber-physical system, the AD system requires a well-designed threat model to understand the security threats and design solutions. This paper explores security issues in the AD system and analyzes the threat model using the STRIDE threat modeling process. We posit that our threat model-based analysis will help improve AVs' security and guide researchers toward developing secure AVs. 
    more » « less