An official website of the United States government
ObjectiveOur objectives were to assess the efficacy of active inference models for capturing driver takeovers from automated vehicles and to evaluate the links between model parameters and self-reported cognitive fatigue, trust, and situation awareness. BackgroundControl transitions between human drivers and automation pose a substantial safety and performance risk. Models of driver behavior that predict these transitions from data are a critical tool for designing safer, human-centered, systems but current models do not sufficiently account for human factors. Active inference theory is a promising approach to integrate human factors because of its grounding in cognition and translation to a quantitative modeling framework. MethodWe used data from a driving simulation to develop an active inference model of takeover performance. After validating the model’s predictions, we used Bayesian regression with a spike and slab prior to assess substantial correlations between model parameters and self-reported trust, situation awareness, fatigue, and demographic factors. ResultsThe model accurately captured driving takeover times. The regression results showed that increases in cognitive fatigue were associated with increased uncertainty about the need to takeover, attributable to mapping observations to environmental states. Higher situation awareness was correlated with a more precise understanding of the environment and state transitions. Higher trust was associated with increased variance in environmental conditions associated with environmental states. ConclusionThe results align with prior theory on trust and active inference and provide a critical connection between complex driver states and interpretable model parameters. ApplicationThe active inference framework can be used in the testing and validation of automated vehicle technology to calibrate design parameters to ensure safety.
more »
« less
Is trust a belief, observation, or state: Results from an active inference analysis of driver-automation transitions of control
Transitions of control are an important safety concern for human-automation teams and automated vehicle safety. While trust and situation awareness have been observed to influence transitions of control in automated vehicles, there are few objective measurements, making these concepts difficult to operationalize in increasingly automated decision systems. In this study, we take a step towards quantifying trust by mapping latent driver beliefs extracted from an active inference-factor analysis model of driver behavior and cognitive dynamics to subjective responses to trust questionnaires. Our results show that subjective trust is primarily correlated with model parameters affecting perceptual evidence accumulation rate, and the same parameters are significantly correlated with driver age.
more »
« less
- Award ID(s):
- 2310621
- PAR ID:
- 10469887
- Publisher / Repository:
- SAGE Publications
- Date Published:
- Journal Name:
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Volume:
- 67
- Issue:
- 1
- ISSN:
- 1071-1813
- Format(s):
- Medium: X Size: p. 1152-1153
- Size(s):
- p. 1152-1153
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Driver reliance on automated vehicles (AV) is a critical component of safety particularly during high-risk traffic scenarios. Factors that influence reliance, including trust, situation awareness, fatigue, and demographics, have been independently explored; however, few analyses have investigated predicting AV reliance and compared factors comprehensively. The goals of this study were to develop a random forest (RF) model to predict reliance and to analyze the importance of factors for reliance decisions. We leveraged data from a driving simulation study where participants encountered four traffic events including responding to an illegal vehicle crossing, managing construction zones, stopping at a vandalized stop sign, and a pedestrian detection task. The dataset included reliance decisions and subjective assessments of dispositional trust, situational trust, fatigue, and workload. An RF model fit to the dataset using cross validation achieved an average AUC of 0.81 and accuracy of 0.77 and situational trust emerged as the most influential predictor.more » « less
-
Trust is crucial for ensuring the safety, security, and widespread adoption of automated vehicles (AVs), and if trust is lacking, drivers and the general public may hesitate to embrace this technology. This research seeks to investigate contextualized trust profiles in order to create personalized experiences for drivers in AVs with varying levels of reliability. A driving simulator experiment involving 70 participants revealed three distinct contextualized trust profiles (i.e., confident copilots, myopic pragmatists, and reluctant automators) identified through K-means clustering, and analyzed in relation to drivers' dynamic trust, dispositional trust, initial learned trust, personality traits, and emotions. The experiment encompassed eight scenarios where participants were requested to take over control from the AV in three conditions: a control condition, a false alarm condition, and a miss condition. To validate the models, a multinomial logistic regression model was constructed using the shapley additive explanations explainer to determine the most influential features in predicting contextualized trust profiles, achieving an F1-score of 0.90 and an accuracy of 0.89. In addition, an examination of how individual factors impact contextualized trust profiles provided valuable insights into trust dynamics from a user-centric perspective. The outcomes of this research hold significant implications for the development of personalized in-vehicle trust monitoring and calibration systems to modulate drivers' trust levels, thereby enhancing safety and user experience in automated driving.more » « less
-
Trust calibration poses a significant challenge in the interaction between drivers and automated vehicles (AVs) in the context of human-automation collaboration. To effectively calibrate trust, it becomes crucial to accurately measure drivers’ trust levels in real time, allowing for timely interventions or adjustments in the automated driving. One viable approach involves employing machine learning models and physiological measures to model the dynamic changes in trust. This study introduces a technique that leverages machine learning models to predict drivers’ real-time dynamic trust in conditional AVs using physiological measurements. We conducted the study in a driving simulator where participants were requested to take over control from automated driving in three conditions that included a control condition, a false alarm condition, and a miss condition. Each condition had eight takeover requests (TORs) in different scenarios. Drivers’ physiological measures were recorded during the experiment, including galvanic skin response (GSR), heart rate (HR) indices, and eye-tracking metrics. Using five machine learning models, we found that eXtreme Gradient Boosting (XGBoost) performed the best and was able to predict drivers’ trust in real time with an f1-score of 89.1% compared to a baseline model of K -nearest neighbor classifier of 84.5%. Our findings provide good implications on how to design an in-vehicle trust monitoring system to calibrate drivers’ trust to facilitate interaction between the driver and the AV in real time.more » « less
-
The use of automation is prevalent in almost every aspect of modern life, and since its inception researchers have been investigating trust in automation. There are many methods of measuring trust. Given that trust means different things to different people and by nature is subjective, most methods are subjective survey assessments (Freedy, DeVisser, Weltman, & Coeyman, 2007; Jian, Bisantz, & Drury, 2000). Many studies have investigated how the reliability of an automated agent or the level of automation changes subjective trust in the automation (Dixon & Wickens, 2006; Du, Zhang, & Yang, 2018; Khasawneh, Rogers, Bertrand, Madathil, & Gramopadhye, 2019; Rogers, Khasawneh, Bertrand, & Madathil, 2017).more » « less
