Self-driving autonomous vehicles (AVs) have recently gained popularity as a research topic. The safety of AVs is exceptionally important as failure in the design of an AV could lead to catastrophic consequences. AV systems are highly heterogeneous with many different and complex components, so it is difficult to perform end-to-end testing. One solution to this dilemma is to evaluate AVs using simulated racing competition. In this thesis, we present a simulated autonomous racing competition, Generalized RAcing Intelligence Competition (GRAIC). To compete in GRAIC, participants need to submit their controller files which are deployed on a racing ego-vehicle on different race tracks. To evaluate the submitted controller, we also developed a testing pipeline, Autonomous System Operations (AutOps). AutOps is an automated, scalable, and fair testing pipeline developed using software engineering techniques such as continuous integration, containerization, and serverless computing. In order to evaluate the submitted controller in non-trivial circumstances, we populate the race tracks with scenarios, which are pre-defined traffic situations commonly seen in the real road. We present a dynamic scenario testing strategy that generates new scenarios based on results of the ego-vehicle passing through previous scenarios. 
                        more » 
                        « less   
                    
                            
                            Scenario2Vector: scenario description language based embeddings for traffic situations
                        
                    
    
            A popular metric for measuring progress in autonomous driving has been the "miles per intervention". This is nowhere near a sufficient metric and it does not allow for a fair comparison between the capabilities of two autonomous vehicles (AVs). In this paper we propose Scenario2Vector - a Scenario Description Language (SDL) based embedding for traffic situations that allows us to automatically search for similar traffic situations from large AV data-sets. Our SDL embedding distills a traffic situation experienced by an AV into its canonical components - actors, actions, and the traffic scene. We can then use this embedding to evaluate similarity of different traffic situations in vector space. We have also created a first of its kind, Traffic Scenario Similarity (TSS) dataset which contains human ranking annotations for the similarity between traffic scenarios. Using the TSS data, we compare our SDL embedding -with textual caption based search methods such as Sentence2Vector. We find that Scenario2Vector outperforms Sentence2Vector by 13% ; and is a promising step towards enabling fair comparisons among AVs by inspecting how they perform in similar traffic situations. We hope that Scenario2Vector can have a similar impact to the AV community that Word2Vec/Sent2Vec have had in Natural Language Processing datasets. 
        more » 
        « less   
        
    
                            - Award ID(s):
- 2046582
- PAR ID:
- 10320138
- Date Published:
- Journal Name:
- ICCPS '21: Proceedings of the ACM/IEEE 12th International Conference on Cyber-Physical Systems
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
- 
            
- 
            Zonta, Daniele; Su, Zhongqing; Glisic, Branko (Ed.)Recent developments in autonomous vehicle (AV) or connected AVs (CAVs) technology have led to predictions that fully self-driven vehicles could completely change the transportation network over the next decades. However, at this stage, AVs and CAVs are still in the development stage which requires various trails in the field and machine learning through autonomous driving miles on real road networks. Until the complete market adoption of autonomous technology, a long transition period of coexistence between conventional and autonomous cars would exist. It is important to study and develop the expected driving behavior of future autonomous cars and the traffic simulation platforms provide an opportunity for researchers and technology developers to implement and assess the different behaviors of self-driving vehicle technology before launching it to the actual ground. This study utilizes PTV VISSIM microsimulation platform to evaluate the mobility performance of unmanned vehicles at a 4-way signalized traffic intersection. The software contains three different AV-ready driving logics such as AV-cautious, AV-normal, and AV-aggressive which were tested against the performance of the conventional vehicles, and the results of the study revealed that the overall network operational performance improves with the progressive introduction of AVs using AV-normal, and AV-aggressive driving behaviors while the AV-cautious driving behavior stays conservative and deteriorates the traffic performance.more » « less
- 
            null (Ed.)Recent decades have witnessed the breakthrough of autonomous vehicles (AVs), and the sensing capabilities of AVs have been dramatically improved. Various sensors installed on AVs will be collecting massive data and perceiving the surrounding traffic continuously. In fact, a fleet of AVs can serve as floating (or probe) sensors, which can be utilized to infer traffic information while cruising around the roadway networks. Unlike conventional traffic sensing methods relying on fixed location sensors or moving sensors that acquire only the information of their carrying vehicle, this paper leverages data from AVs carrying sensors for not only the information of the AVs, but also the characteristics of the surrounding traffic. A high-resolution data-driven traffic sensing framework is proposed, which estimates the fundamental traffic state characteristics, namely, flow, density and speed in high spatio-temporal resolutions and of each lane on a general road, and it is developed under different levels of AV perception capabilities and for any AV market penetration rate. Experimental results show that the proposed method achieves high accuracy even with a low AV market penetration rate. This study would help policymakers and private sectors (e.g., Waymo) to understand the values of massive data collected by AVs in traffic operation and management.more » « less
- 
            A. Ghate, K. Krishnaiyer (Ed.)Deaths due to road traffic accidents are one of the leading causes of death in the United States. Furthermore, the economic impact of road traffic accidents accounts for about 3% of the United States' annual gross domestic product (GDP). In the past decade, extensive research has focused on autonomous vehicles (AVs). This technology is said to help prevent traffic accidents while promoting road traffic safety. This study aims to investigate the safety performance of AVs and identify the significant risk factors associated with the AV collisions. The study considers more than 200 crashes involving AVs and includes vehicle factors, environmental factors, collision type and crash severity. Multinomial logistic regression was conducted with collision type. The results showed no statistically significant risk factors to crash severity. However, movement preceding to collision contributes significantly to collision type. When both vehicles are moving, there's a higher likelihood of an angled collision, 47% to be exact. The other scenario which demonstrates a high probability of an angled collision is when the AV vehicle is not moving while the other is moving. The highest probability for a rear-end collision to occur is when the AV vehicle is not moving while the other is moving. This scenario makes up 55% of the entire rear-end collisions. As for the second-highest proportion, both vehicles moving, it consists of 42%. The research shall help reduce AV involved collisions and increase driving safety.more » « less
- 
            Despite the potential of autonomous vehicles (AV) to improve traffic efficiency and safety, many studies have shown that traffic accidents in a hybrid traffic environment where both AV and human-driven vehicles (HVs) are present are inevitable because of the unpredictability of HVs. Given that eliminating accidents is impossible, an achievable goal is to design AVs in a way so that they will not be blamed for any accident in which they are involved in. In this paper, we propose BlaFT Rules – or Blame-Free hybrid Traffic motion planning Rules. An AV following BlaFT Rules is designed to be cooperative with HVs as well as other AVs, and will not be blamed for accidents in a structured road environment. We provide proofs that no accidents will happen if all AVs are using a BlaFT Rules conforming motion planner, and that an AV using BlaFT Rules will be blame-free even if it is involved in a collision in hybrid traffic. We implemented a motion planning algorithm that conforms to BlaFT Rules called BlaFT. We instantiated scores of BlaFT controlled AVs and HVs in an urban roadscape loop in the SUMO simulator and show that over time that as the percentage of BlaFT vehicles increases, the traffic becomes safer even with HVs involved. Adding BlaFT vehicles increases the efficiency of traffic as a whole by up to 34% over HVs alone.more » « less
 An official website of the United States government
An official website of the United States government 
				
			 
					 
					
 
                                    