skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: How Coordinated Visual Attention on a Target Area of Interest is Impacted by a Change in Workload Over Time
Data-rich environments rely on operators to collaborate, especially in light of workload changes. This work explores the relationship between the operators’ shared visual attention patterns on a target area of interest (AOI), i.e. the AOI causing a workload change, and how it affects collaborative performance. Eye tracking data was collected from ten pairs of participants who completed two scenarios, the first being low workload and the second being high workload, in an unmanned aerial vehicle (UAV) command and control testbed. Then, best and worst performing pairs were compared in terms of two shared visual attention metrics: (1) percent gaze overlap and (2) the phi coefficient for the target AOI. The results showed that coordinated visits to and from the target AOI were associated with better performance during high workload. These results suggest including quantitative measures of visual attention can be indicators of the adaptation process in real- time.  more » « less
Award ID(s):
2008680
PAR ID:
10250014
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Volume:
64
Issue:
1
ISSN:
2169-5067
Page Range / eLocation ID:
366 to 370
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Data rich environments rely on operator collaboration to manage workload changes. This work explores the relationship between operators’ visual attention and collaborative performance during these workload changes. Percent gaze overlap and percent recurrence were calculated over time for best and worst performing pairs of participants who experienced low and high workload in an unmanned aerial vehicle command and control testbed. It was found that the best performing pairs had higher values for both metrics after workload changed. These results suggest successful collaborative performance is dependent on both continuous high levels of synchronized visual attention and coordinated sequences of visual attention. This work has the potential to inform the design of real-time technology. 
    more » « less
  2. Cross-recurrence quantification analysis (CRQA) metrics may offer a means to provide information about the quality of collaboration in real-time. The goal of the present work is to use Area of Interest (AOI) based CRQA metrics to analyze the eye-tracking data of 10 pairs who participated in a shared unmanned aerial vehicle (UAV) command and control task. We are interested in how teams respond to workload transitions and how it affects AOI-based CRQA metrics. The results showed that as workload increased, team members spent a longer time on the same task which may indicate that they are coordinating together on a task, or they are not adapting and getting “trapped” in certain tasks. The findings suggest that CRQA AOI-based metrics are sensitive to workload changes and validate these metrics in unraveling the visual puzzle of how workload impacts scanpath patterns which contribute to quantifying the adaptation process of pairs over time. This also has the potential to inform the design of real-time technology in the future. 
    more » « less
  3. High mental workload, in addition to changes in workload, can negatively affect operators, but it is not clear how sudden versus gradual workload transitions influence performance and visual attention allocation. This knowledge is important as sudden shifts in workload are common in multitasking domains. The objective of this study was to investigate, using performance and eye tracking metrics, how constant versus variable levels of workload affect operators in the context of a dual-task paradigm. An unmanned aerial vehicle command and control simulation varied task load between low, high, gradually transitioning from low to high, and suddenly transitioning from low to high. Performance on a primary and secondary task and several eye tracking measures were calculated. There was no significant difference between sudden and gradual workload transitions in terms of performance or attention allocation overall; however, both sudden and gradual workload transitions changed participants’ strategy in dealing with the primary and secondary task as compared to low/high workload. Also, eye tracking metrics that are not frequently used, such as transition rate and stationary entropy, provided more insight into performance differences. These metrics can potentially be used to better understand operators’ strategies and could form the basis of an adaptive display. 
    more » « less
  4. null (Ed.)
    Changes in task demands can have delayed adverse impacts on performance. This phenomenon, known as the workload history effect, is especially of concern in dynamic work domains where operators manage fluctuating task demands. The existing workload history literature does not depict a consistent picture regarding how these effects manifest, prompting research to consider measures that are informative on the operator's process. One promising measure is visual attention patterns, due to its informativeness on various cognitive processes. To explore its ability to explain workload history effects, participants completed a task in an unmanned aerial vehicle command and control testbed where workload transitioned gradually and suddenly. The participants’ performance and visual attention patterns were studied over time to identify workload history effects. The eye-tracking analysis consisted of using a recently developed eye-tracking metric called coefficient K , as it indicates whether visual attention is more focal or ambient. The performance results found workload history effects, but it depended on the workload level, time elapsed, and performance measure. The eye-tracking analysis suggested performance suffered when focal attention was deployed during low workload, which was an unexpected finding. When synthesizing these results, they suggest unexpected visual attention patterns can impact performance immediately over time. Further research is needed; however, this work shows the value of including a real-time visual attention measure, such as coefficient K , as a means to understand how the operator manages varying task demands in complex work environments. 
    more » « less
  5. Complex and dynamic environments including military operations, healthcare, aviation, and driving require operators to transition seamlessly between levels of mental workload. However, little is known about how the rate of an increase in workload impacts multitasking performance, especially in the context of real-world tasks. We evaluated both gradual and sudden workload increases in the dynamic multitasking environment of an Unmanned Aerial Vehicle (UAV) command and control testbed and compared them to constant workload. Workload transitions were found to improve response time and accuracy compared to when workload was held constant at low or high. These results suggest that workload transitions may allow operators to better regulate mental resources. These findings can also inform the design of operations and technology to assist operators’ management of cognitive resources, which include negating the adverse effects of vigilance decrements during low workload periods and data overload during high workload periods. Background: High workload and workload transitions can affect performance; however, it is not clear how the rate of transition from low to high workload influences performance in a multitasking setting. Purpose: We investigated the effect of workload transition rate on performance in a multitasking environment that is akin to the expectations of operators in complex, data-rich work domains. Method: An Unmanned Aerial Vehicle (UAV) command and control testbed was used to vary workload between low, high, gradually transitioning from low to high, and suddenly transitioning from low to high. Performance measures consisted of the response time and accuracy of one primary task and three secondary tasks. Analyses compared: (a) performance differences between gradual and sudden increases in workload; (b) performance during the low workload phases of the workload transitions; and (c) performance during the high workload phases of the workload transitions. Results: Overall, there were limited performance differences between gradual and sudden workload transitions. However, both types of transitions led to better performance than constant workload, lending some support for the effort regulation explanation which suggests that participants actively evaluated the amount of mental resources necessary to successfully complete a task after a workload transition. Conclusions: Gradual and sudden workload transitions benefit primary and secondary task performance, suggesting that the applicability of existing theoretical explanations depend on the context. For example, varying task demands can be a means to assist operators in the appropriate regulation of mental resources in domains with interdependent tasks. These findings can inform occupation and technology design to support task management. 
    more » « less