skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Comprehensive study of driver behavior monitoring systems using computer vision and machine learning techniques
The flourishing realm of advanced driver-assistance systems (ADAS) as well as autonomous vehicles (AVs) presents exceptional opportunities to enhance safe driving. An essential aspect of this transformation involves monitoring driver behavior through observable physiological indicators, including the driver’s facial expressions, hand placement on the wheels, and the driver’s body postures. An artificial intelligence (AI) system under consideration alerts drivers about potentially unsafe behaviors using real-time voice notifications. This paper offers an all-embracing survey of neu ral network-based methodologies for studying these driver bio-metrics, presenting an exhaustive examination of their advantages and drawbacks. The evaluation includes two relevant datasets, separately categorizing ten different in-cabinet behaviors, providing a systematic classification for driver behaviors detection. The ultimate aim is to inform the development of driver behavior monitoring systems. This survey is a valuable guide for those dedicated to enhancing vehicle safety and preventing accidents caused by careless driving. The paper’s structure encompasses sections on autonomous vehicles, neural networks, driver behavior analysis methods, dataset utilization, and final findings and future suggestions, ensuring accessibility for audiences with diverse levels of understanding regarding the subject matter.  more » « less
Award ID(s):
2231200
PAR ID:
10492030
Author(s) / Creator(s):
Publisher / Repository:
Springer Publisher
Date Published:
Journal Name:
Journal on big data
Volume:
11
Issue:
32
ISSN:
2579-0048
Page Range / eLocation ID:
1-44
Subject(s) / Keyword(s):
Driver behavior monitoring system, Driver behavior classification, Computer vision, Machine learning, Autonomous vehicles
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Autonomous Vehicle (AV) technology has the potential to significantly improve driver safety. Unfortunately, driver could be reluctant to ride with AVs due to the lack of trust and acceptance of AV’s driving styles. The present study investigated the impact of driver’s driving style (aggressive/defensive) and the designed driving styles of AVs (aggressive/defensive) on driver’s trust, acceptance, and take-over behavior in fully autonomous vehicles. Thirty-two participants were classified into two groups based on their driving styles using the Aggressive Driving Scale and experienced twelve scenarios in either an aggressive AV or a defensive AV. Results revealed that drivers’ trust, acceptance, and takeover frequency were significantly influenced by the interaction effects between AV’s driving style and driver’s driving style. The findings implied that driver’s individual differences should be considered in the design of AV’s driving styles to enhance driver’s trust and acceptance of AVs and reduce undesired take over behaviors. 
    more » « less
  2. Autonomous vehicles are expected to improve road safety and efficiency in future transportation systems. A driving simulator study was designed to identify driving styles and the cooperation between human drivers and other AVs. The study captured driver’s following behavior in a fully autonomous driving environment at unsignalized intersections. Participants were asked to make a series of maneuvers (straight through intersection, left turn, and right turn) in two different speed conditions (30, 40 mph) and two different traffic density conditions (with or without other traffic). Analysis of Variance showed that drivers had a significantly larger deviation (defined as the area between two trajectories) during left turn maneuvers when they were traveling at higher speeds. Moreover, the first turning operation had smaller deviation than the second turning operation. The findings have implications for the design of driver-assistance guidance systems in future mixed autonomous and non-autonomous traffic flows. 
    more » « less
  3. Social scientists have argued that autonomous vehicles (AVs) need to act as effective social agents; they have to respond implicitly to other drivers’ behaviors as human drivers would. In this paper, we investigate how contingent driving behavior in AVs influences human drivers’ experiences. We compared three algorithmic driving models: one trained on human driving data that responds to interactions (a familiar contingent behavior) and two artificial models that intend to either always-yield or never-yield regardless of how the interaction unfolds (non-contingent behaviors). Results show a statistically significant relationship between familiar contingent behavior and positive driver experiences, reducing stress while promoting the decisive interactions that mitigate driver hesitance. The direct relationship between familiar contingency and positive experience indicates that AVs should incorporate socially familiar driving patterns through contextually-adaptive algorithms to improve the chances of successful deployment and acceptance in mixed human-AV traffic environments. 
    more » « less
  4. Zonta, Daniele; Su, Zhongqing; Glisic, Branko (Ed.)
    With the rapid development of smart cities, interest in vehicle automation continues growing. Autonomous vehicles are becoming more and more popular among people and are considered to be the future of ground transportation. Autonomous vehicles, either with adaptive cruise control (ACC) or cooperative adaptive cruise control (CACC), provide many possibilities for smart transportation in a smart city. However, traditional vehicles and autonomous vehicles will have to share the same road systems until autonomous vehicles fully penetrate the market over the next few decades, which leads to conflicts because of the inconsistency of human drivers. In this paper, the performance of autonomous vehicles with ACC/CACC and traditional vehicles in mixed driver environments, at a signalized intersection, were evaluated using the micro-simulator VISSIM. In the simulation, the vehicles controlled by the ACC/CACC and Wiedemann 99 (W99) model represent the behavior of autonomous vehicles and human driver vehicles, respectively. For these two different driver environments, four different transport modes were comprehensively investigated: full light duty cars, full trucks, full motorcycles, and mixed conditions. In addition, ten different seed numbers were applied to each model to avoid coincidence. To evaluate the driving behavior of the human drivers and autonomous vehicles, this paper will compare the total number of stops, average velocity, and vehicle delay of each model at the signalized traffic intersection based on a real road intersection in Minnesota. 
    more » « less
  5. Hybrid traffic which involves both autonomous and human-driven vehicles would be the norm of the autonomous vehicles’ practice for a while. On the one hand, unlike autonomous vehicles, human-driven vehicles could exhibit sudden abnormal behaviors such as unpredictably switching to dangerous driving modes – putting its neighboring vehicles under risks; such undesired mode switching could arise from numbers of human driver factors, including fatigue, drunkenness, distraction, aggressiveness, etc. On the other hand, modern vehicle-to-vehicle (V2V) communication technologies enable the autonomous vehicles to efficiently and reliably share the scarce run-time information with each other [1]. In this paper, we propose, to the best of our knowledge, the first efficient algorithm that can (1) significantly improve trajectory prediction by effectively fusing the run-time information shared by surrounding autonomous vehicles, and can (2) accurately and quickly detect abnormal human driving mode switches or abnormal driving behavior with formal assurance without hurting human drivers’ privacy. To validate our proposed algorithm, we first evaluate our proposed trajectory predictor on NGSIM and Argoverse datasets and show that our proposed predictor outperforms the baseline methods. Then through extensive experiments on SUMO simulator, we show that our proposed algorithm has great detection performance in both highway and urban traffic. The best performance achieves detection rate of\(97.3\% \), average detection delay of 1.2s, and 0 false alarm. 
    more » « less