skip to main content


Title: Influence of Expected Reward on Temporal Order Judgment
Perceptual decision-making has been shown to be influenced by reward expected from alternative options or actions, but the underlying neural mechanisms are currently unknown. More specifically, it is debated whether reward effects are mediated through changes in sensory processing, later stages of decision-making, or both. To address this question, we conducted two experiments in which human participants made saccades to what they perceived to be either the first or second of two visually identical but asynchronously presented targets while we manipulated expected reward from correct and incorrect responses on each trial. By comparing reward-induced bias in target selection (i.e., reward bias) during the two experiments, we determined whether reward caused changes in sensory or decision-making processes. We found similar reward biases in the two experiments indicating that reward information mainly influenced later stages of decision-making. Moreover, the observed reward biases were independent of the individual's sensitivity to sensory signals. This suggests that reward effects were determined heuristically via modulation of decision-making processes instead of sensory processing. To further explain our findings and uncover plausible neural mechanisms, we simulated our experiments with a cortical network model and tested alternative mechanisms for how reward could exert its influence. We found that our experimental observations are more compatible with reward-dependent input to the output layer of the decision circuit. Together, our results suggest that, during a temporal judgment task, reward exerts its influence via changing later stages of decision-making (i.e., response bias) rather than early sensory processing (i.e., perceptual bias).  more » « less
Award ID(s):
1632738
NSF-PAR ID:
10158159
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
Journal of Cognitive Neuroscience
Volume:
32
Issue:
4
ISSN:
0898-929X
Page Range / eLocation ID:
674 to 690
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. BACKGROUND Charles Darwin’s  Descent of Man, and Selection in Relation to Sex  tackled the two main controversies arising from the Origin of Species:  the evolution of humans from animal ancestors and the evolution of sexual ornaments. Most of the book focuses on the latter, Darwin’s theory of sexual selection. Research since supports his conjecture that songs, perfumes, and intricate dances evolve because they help secure mating partners. Evidence is overwhelming for a primary role of both male and female mate choice in sexual selection—not only through premating courtship but also through intimate interactions during and long after mating. But what makes one prospective mate more enticing than another? Darwin, shaped by misogyny and sexual prudery, invoked a “taste for the beautiful” without speculating on the origin of the “taste.” How to explain when the “final marriage ceremony” is between two rams? What of oral sex in bats, cloacal rubbing in bonobos, or the sexual spectrum in humans, all observable in Darwin’s time? By explaining desire through the lens of those male traits that caught his eyes and those of his gender and culture, Darwin elided these data in his theory of sexual evolution. Work since Darwin has focused on how traits and preferences coevolve. Preferences can evolve even if attractive signals only predict offspring attractiveness, but most attention has gone to the intuitive but tenuous premise that mating with gorgeous partners yields vigorous offspring. By focusing on those aspects of mating preferences that coevolve with male traits, many of Darwin’s influential followers have followed the same narrow path. The sexual selection debate in the 1980s was framed as “good genes versus runaway”: Do preferences coevolve with traits because traits predict genetic benefits, or simply because they are beautiful? To the broader world this is still the conversation. ADVANCES Even as they evolve toward ever-more-beautiful signals and healthier offspring, mate-choice mechanisms and courter traits are locked in an arms race of coercion and resistance, persuasion and skepticism. Traits favored by sexual selection often do so at the expense of chooser fitness, creating sexual conflict. Choosers then evolve preferences in response to the costs imposed by courters. Often, though, the current traits of courters tell us little about how preferences arise. Sensory systems are often tuned to nonsexual cues like food, favoring mating signals resembling those cues. And preferences can emerge simply from selection on choosing conspecifics. Sexual selection can therefore arise from chooser biases that have nothing to do with ornaments. Choice may occur before mating, as Darwin emphasized, but individuals mate multiple times and bias fertilization and offspring care toward favored partners. Mate choice can thus occur in myriad ways after mating, through behavioral, morphological, and physiological mechanisms. Like other biological traits, mating preferences vary among individuals and species along multiple dimensions. Some of this is likely adaptive, as different individuals will have different optimal mates. Indeed, mate choice may be more about choosing compatible partners than picking the “best” mate in the absolute sense. Compatibility-based choice can drive or reinforce genetic divergence and lead to speciation. The mechanisms underlying the “taste for the beautiful” determine whether mate choice accelerates or inhibits reproductive isolation. If preferences are learned from parents, or covary with ecological differences like the sensory environment, then choice can promote genetic divergence. If everyone shares preferences for attractive ornaments, then choice promotes gene flow between lineages. OUTLOOK Two major trends continue to shift the emphasis away from male “beauty” and toward how and why individuals make sexual choices. The first integrates neuroscience, genomics, and physiology. We need not limit ourselves to the feathers and dances that dazzled Darwin, which gives us a vastly richer picture of mate choice. The second is that despite persistent structural inequities in academia, a broader range of people study a broader range of questions. This new focus confirms Darwin’s insight that mate choice makes a primary contribution to sexual selection, but suggests that sexual selection is often tangential to mate choice. This conclusion challenges a persistent belief with sinister roots, whereby mate choice is all about male ornaments. Under this view, females evolve to prefer handsome males who provide healthy offspring, or alternatively, to express flighty whims for arbitrary traits. But mate-choice mechanisms also evolve for a host of other reasons Understanding mate choice mechanisms is key to understanding how sexual decisions underlie speciation and adaptation to environmental change. New theory and technology allow us to explicitly connect decision-making mechanisms with their evolutionary consequences. A century and a half after Darwin, we can shift our focus to females and males as choosers, rather than the gaudy by-products of mate choice. Mate choice mechanisms across domains of life. Sensory periphery for stimulus detection (yellow), brain for perceptual integration and evaluation (orange), and reproductive structures for postmating choice among pollen or sperm (teal). ILLUSTRATION: KELLIE HOLOSKI/ SCIENCE 
    more » « less
  2. Identifying the directed connectivity that underlie networked activity between different cortical areas is critical for understanding the neural mechanisms behind sensory processing. Granger causality (GC) is widely used for this purpose in functional magnetic resonance imaging analysis, but there the temporal resolution is low, making it difficult to capture the millisecond-scale interactions underlying sensory processing. Magne- toencephalography (MEG) has millisecond resolution, but only provides low-dimensional sensor-level linear mixtures of neural sources, which makes GC inference challenging. Conventional methods proceed in two stages: First, cortical sources are estimated from MEG using a source localization technique, followed by GC inference among the estimated sources. However, the spatiotemporal biases in estimating sources propagate into the subsequent GC analysis stage, may result in both false alarms and missing true GC links. Here, we introduce the Network Localized Granger Causality (NLGC) inference paradigm, which models the source dynamics as latent sparse multivariate autoregressive processes and estimates their parameters directly from the MEG measurements, integrated with source localization, and employs the resulting parameter estimates to produce a precise statistical characterization of the detected GC links. We offer several theoretical and algorithmic innovations within NLGC and further examine its utility via comprehensive simulations and application to MEG data from an auditory task involving tone processing from both younger and older participants. Our simulation studies reveal that NLGC is markedly robust with respect to model mismatch, network size, and low signal-to-noise ratio, whereas the conventional two-stage methods result in high false alarms and mis-detections. We also demonstrate the advantages of NLGC in revealing the cortical network- level characterization of neural activity during tone processing and resting state by delineating task- and age-related connectivity changes. 
    more » « less
  3. Abstract

    As we gather noisy sensory information from the environment, prior knowledge about the likely cause(s) of sensory input can be leveraged to facilitate perceptual judgments. Here, we investigated the computational and neural manifestation of cued expectations in human subjects as they performed a probabilistic face/house discrimination task in which face and house stimuli were preceded by informative or neutral cues. Drift-diffusion modeling of behavioral data showed that cued expectations biased both the baseline (pre-sensory) and drift-rate (post-sensory) of evidence accumulation. By employing a catch-trial functional MRI design we were able to isolate neural signatures of expectation during pre- and post-sensory stages of decision processing in face- and house-selective areas of inferior temporal cortex (ITC). Cue-evoked timecourses were modulated by cues in a manner consistent with a pre-sensory prediction signal that scaled with probability. Sensory-evoked timecourses resembled a prediction-error signal, greater in magnitude for surprising than expected stimuli. Individual differences in baseline and drift-rate biases showed a clear mapping onto pre- and post-sensory fMRI activity in ITC. These findings highlight the specificity of perceptual expectations and provide new insight into the convergence of top-down and bottom-up signals in ITC and their distinct interactions prior to and during sensory processing.

     
    more » « less
  4. null (Ed.)
    Primate vision is characterized by constant, sequential processing and selection of visual targets to fixate. Although expected reward is known to influence both processing and selection of visual targets, similarities and differences between these effects remain unclear mainly because they have been measured in separate tasks. Using a novel paradigm, we simultaneously measured the effects of reward outcomes and expected reward on target selection and sensitivity to visual motion in monkeys. Monkeys freely chose between two visual targets and received a juice reward with varying probability for eye movements made to either of them. Targets were stationary apertures of drifting gratings, causing the end points of eye movements to these targets to be systematically biased in the direction of motion. We used this motion-induced bias as a measure of sensitivity to visual motion on each trial. We then performed different analyses to explore effects of objective and subjective reward values on choice and sensitivity to visual motion to find similarities and differences between reward effects on these two processes. Specifically, we used different reinforcement learning models to fit choice behavior and estimate subjective reward values based on the integration of reward outcomes over multiple trials. Moreover, to compare the effects of subjective reward value on choice and sensitivity to motion directly, we considered correlations between each of these variables and integrated reward outcomes on a wide range of timescales. We found that, in addition to choice, sensitivity to visual motion was also influenced by subjective reward value, although the motion was irrelevant for receiving reward. Unlike choice, however, sensitivity to visual motion was not affected by objective measures of reward value. Moreover, choice was determined by the difference in subjective reward values of the two options, whereas sensitivity to motion was influenced by the sum of values. Finally, models that best predicted visual processing and choice used sets of estimated reward values based on different types of reward integration and timescales. Together, our results demonstrate separable influences of reward on visual processing and choice, and point to the presence of multiple brain circuits for the integration of reward outcomes. 
    more » « less
  5. Prior expectations can bias how we perceive pain. Using a drift diffusion model, we recently showed that this influence is primarily based on changes in perceptual decision-making (indexed as shift in starting point). Only during unexpected application of high-intensity noxious stimuli, altered information processing (indexed as increase in drift rate) explained the expectancy effect on pain processing. Here, we employed functional magnetic resonance imaging to investigate the neural basis of both these processes in healthy volunteers. On each trial, visual cues induced the expectation of high- or low-intensity noxious stimulation or signaled equal probability for both intensities. Participants categorized a subsequently applied electrical stimulus as either low- or high-intensity pain. A shift in starting point towards high pain correlated negatively with right dorsolateral prefrontal cortex activity during cue presentation underscoring its proposed role of “keeping pain out of mind”. This anticipatory right dorsolateral prefrontal cortex signal increase was positively correlated with periaqueductal gray (PAG) activity when the expected high-intensity stimulation was applied. A drift rate increase during unexpected high-intensity pain was reflected in amygdala engagement and increased functional connectivity between amygdala and PAG. Our findings suggest involvement of the PAG in both decision-making bias and altered information processing to implement expectancy effects on pain. 
    more » « less