An official website of the United States government
Understanding the impact of operator characteristics on human-automation interaction (HAI) is crucial as automation becomes pervasive. Despite extensive HAI research, the association between operator characteristics and their dependence on automation has not been thoroughly examined. This study, therefore, examines how individual characteristics affect operator dependence behaviors when interacting with automation. Through a controlled experiment involving 52 participants in a dual-task scenario, we find that operators’ decision-making style, risk propensity, and agreeableness are associated with their dependence behaviors when using automation. This research illuminates the role of personal characteristics in HAI, facilitating personalized team interactions, trust building, and enhanced performance in automated settings.
more »
« less
Toward Quantifying Trust Dynamics: How People Adjust Their Trust After Moment-to-Moment Interaction With Automation
ObjectiveWe examine how human operators adjust their trust in automation as a result of their moment-to-moment interaction with automation. BackgroundMost existing studies measured trust by administering questionnaires at the end of an experiment. Only a limited number of studies viewed trust as a dynamic variable that can strengthen or decay over time. MethodSeventy-five participants took part in an aided memory recognition task. In the task, participants viewed a series of images and later on performed 40 trials of the recognition task to identify a target image when it was presented with a distractor. In each trial, participants performed the initial recognition by themselves, received a recommendation from an automated decision aid, and performed the final recognition. After each trial, participants reported their trust on a visual analog scale. ResultsOutcome bias and contrast effect significantly influence human operators’ trust adjustments. An automation failure leads to a larger trust decrement if the final outcome is undesirable, and a marginally larger trust decrement if the human operator succeeds the task by him/herself. An automation success engenders a greater trust increment if the human operator fails the task. Additionally, automation failures have a larger effect on trust adjustment than automation successes. ConclusionHuman operators adjust their trust in automation as a result of their moment-to-moment interaction with automation. Their trust adjustments are significantly influenced by decision-making heuristics/biases. ApplicationUnderstanding the trust adjustment process enables accurate prediction of the operators’ moment-to-moment trust in automation and informs the design of trust-aware adaptive automation.
more »
« less
- Award ID(s):
- 2045009
- PAR ID:
- 10517145
- Publisher / Repository:
- Sage
- Date Published:
- Journal Name:
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Volume:
- 65
- Issue:
- 5
- ISSN:
- 0018-7208
- Page Range / eLocation ID:
- 862 to 878
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
ObjectiveOur objectives were to assess the efficacy of active inference models for capturing driver takeovers from automated vehicles and to evaluate the links between model parameters and self-reported cognitive fatigue, trust, and situation awareness. BackgroundControl transitions between human drivers and automation pose a substantial safety and performance risk. Models of driver behavior that predict these transitions from data are a critical tool for designing safer, human-centered, systems but current models do not sufficiently account for human factors. Active inference theory is a promising approach to integrate human factors because of its grounding in cognition and translation to a quantitative modeling framework. MethodWe used data from a driving simulation to develop an active inference model of takeover performance. After validating the model’s predictions, we used Bayesian regression with a spike and slab prior to assess substantial correlations between model parameters and self-reported trust, situation awareness, fatigue, and demographic factors. ResultsThe model accurately captured driving takeover times. The regression results showed that increases in cognitive fatigue were associated with increased uncertainty about the need to takeover, attributable to mapping observations to environmental states. Higher situation awareness was correlated with a more precise understanding of the environment and state transitions. Higher trust was associated with increased variance in environmental conditions associated with environmental states. ConclusionThe results align with prior theory on trust and active inference and provide a critical connection between complex driver states and interpretable model parameters. ApplicationThe active inference framework can be used in the testing and validation of automated vehicle technology to calibrate design parameters to ensure safety.more » « less
-
Trust calibration poses a significant challenge in the interaction between drivers and automated vehicles (AVs) in the context of human-automation collaboration. To effectively calibrate trust, it becomes crucial to accurately measure drivers’ trust levels in real time, allowing for timely interventions or adjustments in the automated driving. One viable approach involves employing machine learning models and physiological measures to model the dynamic changes in trust. This study introduces a technique that leverages machine learning models to predict drivers’ real-time dynamic trust in conditional AVs using physiological measurements. We conducted the study in a driving simulator where participants were requested to take over control from automated driving in three conditions that included a control condition, a false alarm condition, and a miss condition. Each condition had eight takeover requests (TORs) in different scenarios. Drivers’ physiological measures were recorded during the experiment, including galvanic skin response (GSR), heart rate (HR) indices, and eye-tracking metrics. Using five machine learning models, we found that eXtreme Gradient Boosting (XGBoost) performed the best and was able to predict drivers’ trust in real time with an f1-score of 89.1% compared to a baseline model of K -nearest neighbor classifier of 84.5%. Our findings provide good implications on how to design an in-vehicle trust monitoring system to calibrate drivers’ trust to facilitate interaction between the driver and the AV in real time.more » « less
-
PurposeThe purpose of this paper is to elaborate the significance of safeguards in digital ecosystems and their role in generating trust among participants. This paper argues that the right mix and number of safeguards are crucial for an ecosystem’s growth and success. It offers ecosystem orchestrators concrete guidelines for how to implement and monitor safeguards. Design/methodology/approachThis research is based on both consulting experience and publicly available information on several digital ecosystems. FindingsThis research conceptualizes safeguards as precautionary mechanisms that mandate or promote desirable behavior in an effort to engender trust among ecosystem participants. Safeguards can take various forms, including passwords, escrow, user privacy controls, ratings and reviews and policies and contracts. Striking the right balance of safeguards – neither too few nor too many – is crucial for ecosystem orchestrators. This paper identifies the factors that determine the optimal mix of safeguards, including the power asymmetry between sellers and buyers, the sophistication of participants, the nature of transactions, the cost of negative outcomes and the cost-benefit tradeoff. Originality/valueTo the best of the authors’ knowledge, this study is one of the first to illuminate the relationship between safeguards and trust in the context of digital ecosystem. It is also one of the few attempts to provide managerial guidance for ecosystem designers trying to structure their platform for trust.more » « less
-
ObjectivesMicrointeraction-based Ecological Momentary Assessment (micro-EMA) is a smartwatch-based tool that delivers single-question surveys, enabling respondents to quickly report their real-time experiences. The objectives of the two studies presented here were to evaluate micro-EMA's psychometric characteristics and feasibility across three response formats (2-point, 5-point, and 10-point scales) for adults with hearing loss. DesignIn the first study, thirty-two participants completed a dual-task experiment aimed at assessing the construct validity, responsiveness, intrusiveness, and test-retest reliability of micro-EMA across the three response formats. Participants listened to sentences at five signal-to-noise ratios (SNRs) ranging from −3 to 9 dB relative to the SNR for 50% speech understanding, answered the question “Hearing well?” on smartwatches, and repeated the sentences. In the second study, twenty-one participants wore smartwatches over 6 days. Every 15 min, participants were prompted to answer the question “Hearing well?” using one of the three response formats for 2 days. Participants provided feedback on their experience with micro-EMA. ResultsIn the dual-task experiment, participants reported improved hearing performance in micro-EMA as SNRs and speech recognition scores increased across all three response formats, supporting the tool's construct validity. Statistical models indicated that the 5-point and 10-point scales yielded larger relative changes between SNRs, suggesting higher responsiveness, compared to the 2-point scale. Participants completed surveys significantly faster with the 2-point scale, indicating lower intrusiveness, compared to the 5-point and 10-point scales. Correlation analysis revealed that over two visits 1 week apart, the 2-point scale had the poorest test-retest reliability, while the 5-point scale had the highest. In the field trial, participants completed 79.6% of the prompted surveys, with each participant averaging 42.9 surveys per day. Although participants experienced interruptions due to frequent prompts, annoyance and distraction levels were low. Most participants preferred the 5-point scale. ConclusionsThe dual-task experiment suggested that micro-EMA using the 5-point scale demonstrated superior psychometric characteristics compared to the 2-point and 10-point scales at the tested SNRs. The field trial further supported its feasibility for evaluating hearing performance in adults with hearing loss. Additional research is needed to explore the potential applications of micro-EMA in audiology research.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript
- Journal Article:
- https://doi.org/10.1177/00187208211034716
