High mental workload, in addition to changes in workload, can negatively affect operators, but it is not clear how sudden versus gradual workload transitions influence performance and visual attention allocation. This knowledge is important as sudden shifts in workload are common in multitasking domains. The objective of this study was to investigate, using performance and eye tracking metrics, how constant versus variable levels of workload affect operators in the context of a dual-task paradigm. An unmanned aerial vehicle command and control simulation varied task load between low, high, gradually transitioning from low to high, and suddenly transitioning from low to high. Performance on a primary and secondary task and several eye tracking measures were calculated. There was no significant difference between sudden and gradual workload transitions in terms of performance or attention allocation overall; however, both sudden and gradual workload transitions changed participants’ strategy in dealing with the primary and secondary task as compared to low/high workload. Also, eye tracking metrics that are not frequently used, such as transition rate and stationary entropy, provided more insight into performance differences. These metrics can potentially be used to better understand operators’ strategies and could form the basis of an adaptive display.
more »
« less
Transitions Between Low and High Levels of Mental Workload can Improve Multitasking Performance
Complex and dynamic environments including military operations, healthcare, aviation, and driving require operators to transition seamlessly between levels of mental workload. However, little is known about how the rate of an increase in workload impacts multitasking performance, especially in the context of real-world tasks. We evaluated both gradual and sudden workload increases in the dynamic multitasking environment of an Unmanned Aerial Vehicle (UAV) command and control testbed and compared them to constant workload. Workload transitions were found to improve response time and accuracy compared to when workload was held constant at low or high. These results suggest that workload transitions may allow operators to better regulate mental resources. These findings can also inform the design of operations and technology to assist operators’ management of cognitive resources, which include negating the adverse effects of vigilance decrements during low workload periods and data overload during high workload periods.
Background: High workload and workload transitions can affect performance; however, it is not clear how the rate of transition from low to high workload influences performance in a multitasking setting.
Purpose: We investigated the effect of workload transition rate on performance in a multitasking environment that is akin to the expectations of operators in complex, data-rich work domains.
Method: An Unmanned Aerial Vehicle (UAV) command and control testbed was used to vary workload between low, high, gradually transitioning from low to high, and suddenly transitioning from low to high. Performance measures consisted of the response time and accuracy of one primary task and three secondary tasks. Analyses compared: (a) performance differences between gradual and sudden increases in workload; (b) performance during the low workload phases of the workload transitions; and (c) performance during the high workload phases of the workload transitions.
Results: Overall, there were limited performance differences between gradual and sudden workload transitions. However, both types of transitions led to better performance than constant workload, lending some support for the effort regulation explanation which suggests that participants actively evaluated the amount of mental resources necessary to successfully complete a task after a workload transition.
Conclusions: Gradual and sudden workload transitions benefit primary and secondary task performance, suggesting that the applicability of existing theoretical explanations depend on the context. For example, varying task demands can be a means to assist operators in the appropriate regulation of mental resources in domains with interdependent tasks. These findings can inform occupation and technology design to support task management.
more »
« less
- Award ID(s):
- 2008680
- NSF-PAR ID:
- 10173451
- Date Published:
- Journal Name:
- IISE Transactions on Occupational Ergonomics and Human Factors
- ISSN:
- 2472-5838
- Page Range / eLocation ID:
- 1 to 16
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Data-rich environments rely on operators to collaborate, especially in light of workload changes. This work explores the relationship between the operators’ shared visual attention patterns on a target area of interest (AOI), i.e. the AOI causing a workload change, and how it affects collaborative performance. Eye tracking data was collected from ten pairs of participants who completed two scenarios, the first being low workload and the second being high workload, in an unmanned aerial vehicle (UAV) command and control testbed. Then, best and worst performing pairs were compared in terms of two shared visual attention metrics: (1) percent gaze overlap and (2) the phi coefficient for the target AOI. The results showed that coordinated visits to and from the target AOI were associated with better performance during high workload. These results suggest including quantitative measures of visual attention can be indicators of the adaptation process in real- time.more » « less
-
null (Ed.)Changes in task demands can have delayed adverse impacts on performance. This phenomenon, known as the workload history effect, is especially of concern in dynamic work domains where operators manage fluctuating task demands. The existing workload history literature does not depict a consistent picture regarding how these effects manifest, prompting research to consider measures that are informative on the operator's process. One promising measure is visual attention patterns, due to its informativeness on various cognitive processes. To explore its ability to explain workload history effects, participants completed a task in an unmanned aerial vehicle command and control testbed where workload transitioned gradually and suddenly. The participants’ performance and visual attention patterns were studied over time to identify workload history effects. The eye-tracking analysis consisted of using a recently developed eye-tracking metric called coefficient K , as it indicates whether visual attention is more focal or ambient. The performance results found workload history effects, but it depended on the workload level, time elapsed, and performance measure. The eye-tracking analysis suggested performance suffered when focal attention was deployed during low workload, which was an unexpected finding. When synthesizing these results, they suggest unexpected visual attention patterns can impact performance immediately over time. Further research is needed; however, this work shows the value of including a real-time visual attention measure, such as coefficient K , as a means to understand how the operator manages varying task demands in complex work environments.more » « less
-
Data rich environments rely on operator collaboration to manage workload changes. This work explores the relationship between operators’ visual attention and collaborative performance during these workload changes. Percent gaze overlap and percent recurrence were calculated over time for best and worst performing pairs of participants who experienced low and high workload in an unmanned aerial vehicle command and control testbed. It was found that the best performing pairs had higher values for both metrics after workload changed. These results suggest successful collaborative performance is dependent on both continuous high levels of synchronized visual attention and coordinated sequences of visual attention. This work has the potential to inform the design of real-time technology.more » « less
-
Given there is no unifying theory or design guidance for workload transitions, this work investigated how visual attention allocation patterns could inform both topics, by understanding if scan-based eye tracking metrics could predict workload transition performance trends in a context-relevant domain. The eye movements of sixty Naval flight students were tracked as workload transitioned at a slow, medium, and fast pace in an unmanned aerial vehicle testbed. Four scan-based metrics were significant predictors across the different growth curve models of response time and accuracy. Stationary gaze entropy (a measure of how dispersed visual attention transitions are across tasks) was predictive across all three transition rates. The other three predictive scan-based metrics captured different aspects of visual attention, including its spread, directness, and duration. The findings specify several missing details in both theory and design guidance, which is unprecedented, and serves as a basis of future workload transition research.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1080/24725838.2020.1770898
