skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Estimating cognitive biases with attention-aware inverse planning
People's goal-directed behaviors are influenced by their cognitive biases, and autonomous systems that interact with people should be aware of this. For example, people's attention to objects in their environment will be biased in a way that systematically affects how they perform everyday tasks such as driving to work. Here, building on recent work in computational cognitive science, we formally articulate the attention-aware inverse planning problem, in which the goal is to estimate a person's attentional biases from their actions. We demonstrate how attention-aware inverse planning systematically differs from standard inverse reinforcement learning and how cognitive biases can be inferred from behavior. Finally, we present an approach to attention-aware inverse planning that combines deep reinforcement learning with computational cognitive modeling. We use this approach to infer the attentional strategies of RL agents in real-life driving scenarios selected from the Waymo Open Dataset, demonstrating the scalability of estimating cognitive biases with attention-aware inverse planning.  more » « less
Award ID(s):
2434192 2348442
PAR ID:
10674035
Author(s) / Creator(s):
; ; ; ; ; ; ;
Publisher / Repository:
Curran Associates, Inc.
Date Published:
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Goal‐directed behavior is a deeply important part of human psychology. People constantly set goals for themselves and pursue them in many domains of life. In this paper, we develop computational models that characterize how humans pursue goals in a complex dynamic environment and test how well they describe human behavior in an experiment. Our models are motivated by the principle of resource rationality and draw upon psychological insights about people's limited attention and planning capacities. We find that human goal pursuit is qualitatively different and substantially less efficient than optimal goal pursuit in our simulated environment. Models of goal pursuit based on the principle of resource rationality capture human behavior better than both a model of optimal goal pursuit and heuristics that are not resource‐rational. We conclude that the way humans pursue goals is shaped by the need to achieve goals effectively as well as cognitive costs and constraints on planning and attention. Our findings are an important step toward understanding humans' goal pursuit as cognitive limitations play a crucial role in shaping people's goal‐directed behavior. 
    more » « less
  2. A worker’s attentional and cognitive failures—such as lack of attention, failure to identify a tripping hazard, or misperception about a hazard’s risks—can lead to unsafe behaviors and, consequently, accidents. Previous literature has shown that individual characteristics such as personality may affect human’s selective attention. However, few studies have attempted to empirically examine how a worker’s personality affects attention and situation awareness on a jobsite. The present study examines how workers’ emotional stability (neuroticism) affects their cognitive failures (especially attentional failure) when they are exposed to fall-to-same-level hazardous conditions. To achieve this goal—and given that eye movements represent the most direct manifestation of visual attention—the personalities of construction workers were assessed via self-completion questionnaires, and their attention and situation awareness were monitored continuously and in real-time using a mobile wearable eye-tracking apparatus. Correlational analyses revealed the significant relationship between neuroticism and the attentional distribution of workers. These results suggest that workers do not allocate their attention equally to all hazardous areas and these differences in attentional distribution are modulated by personality characteristics (neuroticism). A more detailed investigation of this connection yielded a specific pattern: less neurotic workers periodically look down and scan ahead to obtain feedforward information about tripping hazards, and these individuals remain fully aware of the environment and its associated hazards. The findings of this study suggest the value assessing personality to identify workers who are more likely to be involved in accidents. 
    more » « less
  3. We developed a novel Proactive Reactive and Attentional Dynamics (PRAD) computational model designed to dissect the latent mechanisms of inhibitory control in human cognition. Leveraging data from over 7,500 participants in the NIH Adolescent Brain Cognitive Development study, we demonstrate that PRAD surpasses traditional models by integrating proactive, reactive, and attentional components of inhibitory control. Employing a hierarchical Bayesian framework, PRAD offers a granular view of the dynamics underpinning action execution and inhibition, provides debiased estimates of stop-signal reaction times, and elucidates individual and temporal variability in cognitive control processes. Our findings reveal significant intra-individual variability, challenging conventional assumptions of random variability across trials. By addressing nonergodicity and systematically accounting for the multi-componential nature of cognitive control, PRAD advances our understanding of the cognitive mechanisms driving individual differences in cognitive control and provides a sophisticated computational framework for dissecting dynamic cognitive processes across diverse populations. 
    more » « less
  4. null (Ed.)
    What makes one person better at controlling attention than the next person? Attempts to answer this question have largely focused on measuring individuals’ cognitive abilities. However, variation in attentional performance can also be due to differences in strategy. Here, we describe research showing that individuals vary dramatically in how they choose to control attention, with many reliably choosing suboptimal strategies. Optimal strategy choice appears to be unrelated to attentional control ability, general cognitive ability, or even strategy choice on other attention tasks. It does, however, correlate with how effortful individuals find the optimal strategy, which suggests that strategy choice may be driven by subjective, task-specific effort demands. These findings represent initial steps toward fully characterizing an individual profile of attentional control strategies. 
    more » « less
  5. Accounting for individual differences can improve the effectiveness of visualization design. While the role of visual attention in visualization interpretation is well recognized, existing work often overlooks how this behavior varies based on visual literacy levels. Based on data from a 235-participant user study covering three visualization tests (mini-VLAT, CALVI, and SGL), we show that distinct attention patterns in visual data exploration can correlate with participants' literacy levels: While experts (high-scorers) generally show a strong attentional focus, novices (low-scorers) focus less and explore more. We then propose two computational models leveraging these insights: Lit2Sal - a novel visual saliency model that predicts observer attention given their visualization literacy level, and Sal2Lit - a model to predict visual literacy from human visual attention data. Our quantitative and qualitative evaluation demonstrates that Lit2Sal outperforms state-of-the-art saliency models with literacy-aware considerations. Sal2Lit predicts literacy with 86% accuracy using a single attention map, providing a time-efficient supplement to literacy assessment that only takes less than a minute. Taken together, our unique approach to consider individual differences in salience models and visual attention in literacy assessments paves the way for new directions in personalized visual data communication to enhance understanding. 
    more » « less