skip to main content


This content will become publicly available on December 1, 2024

Title: Real-Time Trust Prediction in Conditionally Automated Driving Using Physiological Measures
Trust calibration poses a significant challenge in the interaction between drivers and automated vehicles (AVs) in the context of human-automation collaboration. To effectively calibrate trust, it becomes crucial to accurately measure drivers’ trust levels in real time, allowing for timely interventions or adjustments in the automated driving. One viable approach involves employing machine learning models and physiological measures to model the dynamic changes in trust. This study introduces a technique that leverages machine learning models to predict drivers’ real-time dynamic trust in conditional AVs using physiological measurements. We conducted the study in a driving simulator where participants were requested to take over control from automated driving in three conditions that included a control condition, a false alarm condition, and a miss condition. Each condition had eight takeover requests (TORs) in different scenarios. Drivers’ physiological measures were recorded during the experiment, including galvanic skin response (GSR), heart rate (HR) indices, and eye-tracking metrics. Using five machine learning models, we found that eXtreme Gradient Boosting (XGBoost) performed the best and was able to predict drivers’ trust in real time with an f1-score of 89.1% compared to a baseline model of K -nearest neighbor classifier of 84.5%. Our findings provide good implications on how to design an in-vehicle trust monitoring system to calibrate drivers’ trust to facilitate interaction between the driver and the AV in real time.  more » « less
Award ID(s):
2138274
NSF-PAR ID:
10500437
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
IEEE Transactions on Intelligent Transportation Systems
Date Published:
Journal Name:
IEEE Transactions on Intelligent Transportation Systems
Volume:
24
Issue:
12
ISSN:
1524-9050
Page Range / eLocation ID:
14642 to 14650
Subject(s) / Keyword(s):
["Trust prediction, physiological measures, real time, machine learning, automated vehicles"]
Format(s):
Medium: X Other: pdf
Sponsoring Org:
National Science Foundation
More Like this
  1. Objective This study develops a computational model to predict drivers’ response time and understand the underlying cognitive mechanism for freeway exiting takeovers in conditionally automated vehicles (AVs). Background Previous research has modeled drivers’ takeover response time in emergency scenarios that demand a quick response. However, existing models may not be applicable for scheduled, non-time-critical takeovers as drivers take longer to resume control when there is no time pressure. A model of driver response time in non-time-critical takeovers is lacking. Method A computational cognitive model of driver takeover response time is developed based on Queuing Network-Model Human Processor (QN-MHP) architecture. The model quantifies gaze redirection in response to takeover request (ToR), task prioritization, driver situation awareness, and driver trust to address the complexities of drivers' takeover strategies when sufficient time budget exists. Results Experimental data of a preliminary driving simulator study were used to validate the model. The model accounted for 97% of the experimental takeover response time for freeway exiting. Conclusion The current model can successfully predict drivers’ response time for scheduled, non-time-critical freeway exiting takeovers in conditionally AVs. Application This model can be applied to the human-machine interface design with respect to ToR lead time for enhancing safe freeway exiting takeovers in conditionally AVs. It also provides a foundation for future modeling work towards an integrated driver model of freeway exiting takeover performance. 
    more » « less
  2. In highly and fully automated vehicles (AV), drivers could divert their attention to non-driving-related activities. Drivers may also take over AVs if they do not trust the way AVs drive in specific driving scenarios. Existing models have been developed to predict drivers’ takeover performance in responding to takeover requests initiated by AVs in semi-AVs. However, few models predicted driver-initiated takeover behavior in highly and fully AVs. The present study develops an attention-based multiple-input Convolutional Neural Network (CNN) to predict drivers’ takeover intention in fully AVs. The results indicated that the developed model successfully predicted takeover intentions of drivers with a precision of 0.982 and an F1-Score of.989, which were found to be substantially higher than other machine learning algorithms. The developed CNN model could be applied in improving the driving algorithms of the AV by considering drivers’ driving styles to reduce drivers’ unnecessary takeover behaviors. 
    more » « less
  3. This study proposes a novel methodology for modeling driver takeover behavior in conditionally automated vehicles (AVs) when exiting a freeway using deep learning (DL) network architectures. While previous research has focused on modeling takeover time in emergency scenarios, which require quick responses, these models may not be applicable to scheduled, non-time-critical takeovers. In such situations, drivers may employ varying strategies and take longer to resume control of the vehicle when there is no time pressure. To address this problem, a deep learning architecture based on a convolutional neural network (CNN) was implemented to predict drivers’ takeover behaviors in scheduled takeovers. The model was trained on drivers’ driving data and eye gaze with varying time windows, facilitating an analysis of drivers’ takeover decisions to various takeover request designs. The model achieved good performance metrics, with an F1 Score of 0.993, a recall of 0.996, and a precision of 0.991. The application of these models holds substantial potential for refining the design of the human-machine interface, specifically in calibrating the takeover request (ToR) lead time, thereby promoting safe freeway exiting takeovers in conditionally AVs.

     
    more » « less
  4. Objective

    This study explores subjective and objective driving style similarity to identify how similarity can be used to develop driver-compatible vehicle automation.

    Background

    Similarity in the ways that interaction partners perform tasks can be measured subjectively, through questionnaires, or objectively by characterizing each agent’s actions. Although subjective measures have advantages in prediction, objective measures are more useful when operationalizing interventions based on these measures. Showing how objective and subjective similarity are related is therefore prudent for aligning future machine performance with human preferences.

    Methods

    A driving simulator study was conducted with stop-and-go scenarios. Participants experienced conservative, moderate, and aggressive automated driving styles and rated the similarity between their own driving style and that of the automation. Objective similarity between the manual and automated driving speed profiles was calculated using three distance measures: dynamic time warping, Euclidean distance, and time alignment measure. Linear mixed effects models were used to examine how different components of the stopping profile and the three objective similarity measures predicted subjective similarity.

    Results

    Objective similarity using Euclidean distance best predicted subjective similarity. However, this was only observed for participants’ approach to the intersection and not their departure.

    Conclusion

    Developing driving styles that drivers perceive to be similar to their own is an important step toward driver-compatible automation. In determining what constitutes similarity, it is important to (a) use measures that reflect the driver’s perception of similarity, and (b) understand what elements of the driving style govern subjective similarity.

     
    more » « less
  5. Objective

    This study investigated the impact of driving styles of drivers and automated vehicles (AVs) on drivers’ perception of automated driving maneuvers and quantified the relationships among drivers’ perception of AV maneuvers, driver trust, and acceptance of AVs.

    Background

    Previous studies on automated driving styles focused on the impact of AV’s global driving style on driver’s attitude and driving performance. However, research on drivers’ perception of automated driving maneuvers at the specific driving style level is still lacking.

    Method

    Sixteen aggressive drivers and sixteen defensive drivers were recruited to experience twelve driving scenarios in either an aggressive AV or a defensive AV on the driving simulator. Their perception of AV maneuvers, trust, and acceptance was measured via questionnaires, and driving performance was collected via the driving simulator.

    Results

    Results revealed that drivers’ trust and acceptance of AVs would decrease significantly if they perceived AVs to have a higher speed, larger deceleration, smaller deceleration, or shorter stopping distance than expected. Moreover, defensive drivers perceived significantly greater inappropriateness of these maneuvers from aggressive AVs than defensive AVs, whereas aggressive drivers didn’t differ significantly in their perceived inappropriateness of these maneuvers with different driving styles.

    Conclusion

    The driving styles of automated vehicles and drivers influenced drivers’ perception of automated driving maneuvers, which influence their trust and acceptance of AVs.

    Application

    This study suggested that the design of AVs should consider drivers’ perceptions of automated driving maneuvers to avoid undermining drivers’ trust and acceptance of AVs.

     
    more » « less