skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Performance and Relative Risk Dynamics during Driving Simulation Tasks under Distinct Automation Conditions
Risk has been a key factor influencing trust in Human-Automation interactions, though there is no unified tool to study its dynamics. We provide a framework for defining and assessing relative risk of automation usage through performance dynamics and apply this framework to a dataset from a previous study. Our approach allows us to explore how operators’ ability and different automation conditions impact the performance and relative risk dynamics. Our results on performance dynamics show that, on average, operators perform better (1) using automation that is more reliable and (2) using partial automation (more workload) than full automation (less workload). Our analysis of relative risk dynamics indicates that automation with higher reliability has higher relative risk dynamics. This suggests that operators are willing to take more risk for automation with higher reliability. Additionally, when the reliability of automation is lower, operators adapt their behavior to result in lower risk.  more » « less
Award ID(s):
1828010
PAR ID:
10432739
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Volume:
66
Issue:
1
ISSN:
2169-5067
Page Range / eLocation ID:
1230 to 1234
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The decision process of engaging or disengaging automation has been termed reliance on automation, and it has been widely analyzed as a summary measure of automation usage rather than a dynamic measure. We provide a framework for defining temporal reliance dynamics and apply it to a data-set from a previous study. Our findings show that (1) the higher the reliability of an automated system, the larger the reliance over time; and (2) more workload created by the automation type does not significantly affect the operators’ reliance dynamics in high-reliability systems, but it does produce greater reliance in low-reliability systems. Furthermore, on average, operators with low performance make fewer decision changes and prefer to stick to their decision of using automation even if it is not performing well. Operators with high performance, on average, have a higher frequency of decision change, and therefore, their automation usage periods are shorter. 
    more » « less
  2. Adaptive task allocation is used in many human-machine systems and has been proven to improve operators’ performance with automated systems. However, there has been limited knowledge surrounding the benefits of adaptive task allocation in automated vehicles. In this study, participants were presented with photos and videos depicting driving scenarios of low or high workloads at two levels of automation (SAE Levels 2 and 3). The participants reported which tasks they felt comfortable allocating to themselves or to the driving automation system (DAS) in each driving scenario, as well as whether they would conduct the task allocation manually or have the DAS automatically allocate the tasks. Our results showed that participants preferred conducting manual task allocation and preferred the system to complete more tasks when the perceived workload was high. There was no significant difference between the high and low workload scenarios in terms of whether participants chose to allocate tasks. 
    more » « less
  3. Understanding the impact of operator characteristics on human-automation interaction (HAI) is crucial as automation becomes pervasive. Despite extensive HAI research, the association between operator characteristics and their dependence on automation has not been thoroughly examined. This study, therefore, examines how individual characteristics affect operator dependence behaviors when interacting with automation. Through a controlled experiment involving 52 participants in a dual-task scenario, we find that operators’ decision-making style, risk propensity, and agreeableness are associated with their dependence behaviors when using automation. This research illuminates the role of personal characteristics in HAI, facilitating personalized team interactions, trust building, and enhanced performance in automated settings. 
    more » « less
  4. Abstract Airside economizers lower the operating cost of data centers by reducing or eliminating mechanical cooling. It, however, increases the risk of reliability degradation of information technology (IT) equipment due to contaminants. IT Equipment manufacturers have tested equipment performance and guarantee the reliability of their equipment in environments within ISA 71.04-2013 severity level G1 and the ASHRAE recommended temperature-relative humidity (RH) envelope. IT Equipment manufacturers require data center operators to meet all the specified conditions consistently before fulfilling warranty on equipment failure. To determine the reliability of electronic hardware in higher severity conditions, field data obtained from real data centers are required. In this study, a corrosion classification coupon experiment as per ISA 71.04-2013 was performed to determine the severity level of a research data center (RDC) located in an industrial area of hot and humid Dallas. The temperature-RH excursions were analyzed based on time series and weather data bin analysis using trend data for the duration of operation. After some period, a failure was recorded on two power distribution units (PDUs) located in the hot aisle. The damaged hardware and other hardware were evaluated, and cumulative corrosion damage study was carried out. The hypothetical estimation of the end of life of components is provided to determine free air-cooling hours for the site. There was no failure of even a single server operated with fresh air-cooling shows that using evaporative/free air cooling is not detrimental to IT equipment reliability. This study, however, must be repeated in other geographical locations to determine if the contamination effect is location dependent. 
    more » « less
  5. High mental workload, in addition to changes in workload, can negatively affect operators, but it is not clear how sudden versus gradual workload transitions influence performance and visual attention allocation. This knowledge is important as sudden shifts in workload are common in multitasking domains. The objective of this study was to investigate, using performance and eye tracking metrics, how constant versus variable levels of workload affect operators in the context of a dual-task paradigm. An unmanned aerial vehicle command and control simulation varied task load between low, high, gradually transitioning from low to high, and suddenly transitioning from low to high. Performance on a primary and secondary task and several eye tracking measures were calculated. There was no significant difference between sudden and gradual workload transitions in terms of performance or attention allocation overall; however, both sudden and gradual workload transitions changed participants’ strategy in dealing with the primary and secondary task as compared to low/high workload. Also, eye tracking metrics that are not frequently used, such as transition rate and stationary entropy, provided more insight into performance differences. These metrics can potentially be used to better understand operators’ strategies and could form the basis of an adaptive display. 
    more » « less