skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Neural Substrates Mediating the Utility of Instrumental Divergence
We assessed the neural substrates mediating a recently demonstrated preference for environments with high levels of instrumental divergence – a formal index of flexible operant control. Across choice scenarios, participants chose between gambling environments that differed in terms of both instrumental divergence and expected monetary pay-offs. Using model-based fMRI, we found that activity in the ventromedial prefrontal cortex scaled with a divergence-based measure of expected utility that reflected the value of both divergence and monetary reward. Implications for a neural common currency for information theoretic and economic variables are discussed.  more » « less
Award ID(s):
1654187
PAR ID:
10132584
Author(s) / Creator(s):
Date Published:
Journal Name:
Proceedings of the 41st Annual Conference of the Cognitive Science Society
Page Range / eLocation ID:
2475-2480
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. A large literature has demonstrated an abnormal sense of agency (SOA) in schizophrenic individuals. One limitation of such studies is that they focus exclusively on cognitive or perceptual judgments, thus failing to address affective aspects of SOA. In our recent work, we have used instrumental divergence – the distance between outcome probability distributions associated with available actions – as a formal measure of agency, demonstrating an influence of this novel decision variable on behavioral choice preferences and associated neural computations in neurotypical adults. Here, we show that the preference for high instrumental divergence (i.e., for high-agency environments) is significantly modulated by individual differences in positive and negative schizotypy dimensions. Implications for future assessments of clinical populations are discussed. 
    more » « less
  2. Abstract Visual attention, the selective prioritization of sensory information, is crucial in dynamic, information-rich environments. That both internal goals and external salience modulate the allocation of attention is well established. However, recent empirical work has found instances of experience-driven attention, wherein task-irrelevant, physically non-salient stimuli reflexively capture attention in ways that are contingent on an observer’s unique history. The prototypical example of experience-driven attention relies on a history of reward associations, with evidence attributing the phenomenon to reward-prediction errors. However, a mechanistic account, differing from the reward-prediction error hypothesis, is needed to explain how, in the absence of monetary reward, a history of target-seeking leads to attentional capture. Here we propose that what drives attentional capture in such cases is not target-seeking, but an association with instrumental information. To test this hypothesis, we used pre-cues to render the information provided by a search target either instrumental or redundant. We found that task-irrelevant, physically non-salient distractors associated with instrumental information were more likely to draw eye movements (a sensitive metric of information sampling) than were distractors associated with redundant information. Furthermore, saccading to an instrumental-information-associated distractor led to a greater behavioral cost: response times were slowed more severely. Crucially, the distractors had equivalent histories as sought targets, so any attentional differences between them must be due to different information histories resulting from our experimental manipulation. These findings provide strong evidence for the information history hypothesis and offer a method for exploring the neural signature of information-driven attentional capture. 
    more » « less
  3. Abstract Motivation is often thought to enhance adaptive decision-making by biasing actions toward rewards and away from punishment. Emerging evidence, however, points to a more nuanced view whereby motivation can both enhance and impair different aspects of decision-making. Model-based approaches have gained prominence over the past decade for developing more precise mechanistic explanations for how incentives impact goal-directed behavior. In this Special Focus, we highlight three studies that demonstrate how computational frameworks help decompose decision processes into constituent cognitive components, as well as formalize when and how motivational factors (e.g., monetary rewards) influence specific cognitive processes, decision-making strategies, and self-report measures. Finally, I conclude with a provocative suggestion based on recent advances in the field: that organisms do not merely seek to maximize the expected value of extrinsic incentives. Instead, they may be optimizing decision-making to achieve a desired internal state (e.g., homeostasis, effort, affect). Future investigation into such internal processes will be a fruitful endeavor for unlocking the cognitive, computational, and neural mechanisms of motivated decision-making. 
    more » « less
  4. Human ratings are ubiquitous in creativity research. Yet the process of rating responses to creativity tasks—typically several hundred or thousands of responses, per rater—is often time consuming and expensive. Planned missing data designs, where raters only rate a subset of the total number of responses, have been recently proposed as one possible solution to decrease overall rating time and monetary costs. However, researchers also need ratings that adhere to psychometric standards, such as a certain degree of reliability, and psychometric work with planned missing designs is currently lacking in the literature. In this work, we introduce how judge response theory and simulations can be used to fine-tune planning of missing data designs. We provide open code for the community and illustrate our proposed approach by a cost-effectiveness calculation based on a realistic example. We clearly show that fine tuning helps to save time (to perform the ratings) and monetary costs, while simultaneously targeting expected levels of reliability. 
    more » « less
  5. A loss function measures the discrepancy between the true values (observations) and their estimated fits, for a given instance of data. A loss function is said to be proper (unbiased, Fisher consistent) if the fits are defined over a unit simplex, and the minimizer of the expected loss is the true underlying probability of the data. Typical examples are the zero-one loss, the quadratic loss and the Bernoulli log-likelihood loss (log-loss). In this work we show that for binary classification problems, the divergence associated with smooth, proper and convex loss functions is bounded from above by the Kullback-Leibler (KL) divergence, up to a multiplicative normalization constant. It implies that by minimizing the log-loss (associated with the KL divergence), we minimize an upper bound to any choice of loss functions from this set. This property justifies the broad use of log-loss in regression, decision trees, deep neural networks and many other applications. In addition, we show that the KL divergence bounds from above any separable Bregman divergence that is convex in its second argument (up to a multiplicative normalization constant). This result introduces a new set of divergence inequalities, similar to the well-known Pinsker inequality. 
    more » « less