The acquisition of instrumental responding can be supported by primary reinforcers or by conditional (also known as secondary) reinforcers that themselves have an association to a primary reinforcer. While primary reinforcement has been heavily studied for the past century, the associative basis of conditioned reinforcement has received comparatively little experimental examination. Yet conditioned reinforcement has been employed as an important behavioral assay in neuroscience studies, and thus an analysis of its associative basis is called for. We evaluated the extent to which an element from a previously trained compound would facilitate conditioned reinforcement. Three groups of rats received Pavlovian conditioning with a visual-auditory compound cue followed by food. After training, a lever was made available that, when pressed, produced the same trained compound (group compound), only the auditory cue (group element), or a novel auditory cue (group control). The rats in group compound pressed the lever at a higher rate than did rats in either group element or group control, demonstrating a strong conditioned reinforcement effect only in group compound. Interestingly, there was almost no difference in responding between group element and group control. The implications of this generalization decrement in conditioned reinforcement are discussed—particularly as they relate to research in behavioral neuroscience.
more »
« less
Elements of a Compound Elicit Little Conditioned Reinforcement
The acquisition of instrumental responding can be supported by primary reinforcers or by conditional (also known as secondary) reinforcers that themselves have an association to a primary reinforcer. While primary reinforcement has been heavily studied for the past century, the associative basis of conditioned reinforcement has received comparatively little experimental examination. Yet conditioned reinforcement has been employed as an important behavioral assay in neuroscience studies, and thus an analysis of its associative basis is called for. We evaluated the extent to which an element from a previously
trained compound would facilitate conditioned reinforcement. Three groups of rats received
Pavlovian conditioning with a visual-auditory compound cue followed by food. After training, a lever was made available that, when pressed, produced the same trained compound (group compound), only the auditory cue (group element), or a novel auditory cue (group control). The rats in group compound pressed the lever at a higher rate than did rats in either group element or group control, demonstrating a strong conditioned reinforcement effect only in group compound. Interestingly, there was almost no difference in responding between group element and group control. The implications of this generalization decrement in conditioned reinforcement are discussed—particularly as they relate to research in behavioral neuroscience.
more »
« less
- Award ID(s):
- 1844144
- NSF-PAR ID:
- 10288526
- Date Published:
- Journal Name:
- Journal of experimental psychology
- ISSN:
- 0278-7393
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Humans and other animals are capable of reasoning. However, there are overwhelming examples of errors or anomalies in reasoning. In two experiments, we studied if rats, like humans, estimate the conjunction of two events as more likely than each event independently, a phenomenon that has been called conjunction fallacy. In both experiments, rats learned through food reinforcement to press a lever under some cue conditions but not others. Sound B was rewarded whereas Sound A was not. However, when B was presented with the visual cue Y was not rewarded, whereas AX was rewarded (i.e., A-, AX+, B+, BY-). Both visual cues were presented in the same bulb. After training, rats received test sessions in which A and B were presented with the bulb explicitly off or occluded by a metal piece. Thus, on the occluded condition, it was ambiguous whether the trials were of the elements alone (A or B) or of the compounds (AX or BY). Rats responded on the occluded condition as if the compound cues were most likely present. The second experiment investigated if this error in probability estimation in Experiment 1, could be due to a conjunction fallacy, and if this could be attenuated by increasing the ratio of element/compound trials from the original 50-50 to 70-30 and 90-10. Only the 90-10 condition (where 90% of the training trials were of just A or just B) did not show a conjunction fallacy, though it emerged in all groups with additional training. These findings open new avenues for exploring the mechanisms behind the conjunction fallacy effect.more » « less
-
more » « less
The survival of an organism is dependent on its ability to respond to cues in the environment. Such cues can attain control over behavior as a function of the value ascribed to them. Some individuals have an inherent tendency to attribute reward-paired cues with incentive motivational value, or incentive salience. For these individuals, termed sign-trackers, a discrete cue that precedes reward delivery becomes attractive and desirable in its own right. Prior work suggests that the behavior of sign-trackers is dopamine-dependent, and cue-elicited dopamine in the NAc is believed to encode the incentive value of reward cues. Here we exploited the temporal resolution of optogenetics to determine whether selective inhibition of ventral tegmental area (VTA) dopamine neurons during cue presentation attenuates the propensity to sign-track. Using male tyrosine hydroxylase
(TH)-Cre Long Evans rats, it was found that, under baseline conditions, ∼84% ofTH-Cre rats tend to sign-track. Laser-induced inhibition of VTA dopamine neurons during cue presentation prevented the development of sign-tracking behavior, without affecting goal-tracking behavior. When laser inhibition was terminated, these same rats developed a sign-tracking response. Video analysis using DeepLabCutTMrevealed that, relative to rats that received laser inhibition, rats in the control group spent more time near the location of the reward cue even when it was not present and were more likely to orient toward and approach the cue during its presentation. These findings demonstrate that cue-elicited dopamine release is critical for the attribution of incentive salience to reward cues.SIGNIFICANCE STATEMENT Activity of dopamine neurons in the ventral tegmental area (VTA) during cue presentation is necessary for the development of a sign-tracking, but not a goal-tracking, conditioned response in a Pavlovian task. We capitalized on the temporal precision of optogenetics to pair cue presentation with inhibition of VTA dopamine neurons. A detailed behavioral analysis with DeepLabCutTMrevealed that cue-directed behaviors do not emerge without dopamine neuron activity in the VTA. Importantly, however, when optogenetic inhibition is lifted, cue-directed behaviors increase, and a sign-tracking response develops. These findings confirm the necessity of dopamine neuron activity in the VTA during cue presentation to encode the incentive value of reward cues. -
more » « less
Abstract A critical area of inquiry in the neurobiology of alcohol abuse is the mechanism by which cues gain the ability to elicit alcohol use. Previously, we found that cue‐evoked activity in rat ventral pallidum robustly encodes the value of sucrose cues trained under both Pavlovian and instrumental contingencies, despite a stronger relationship between cue‐evoked activity and behavioral latency after instrumental training (Richard et al., 2018,
Elife ,7 , e33107). Here, we assessed: (a) ventral pallidal representations of Pavlovian versus instrumental cues trained with alcohol reward, and (b) the impact of non‐associative alcohol exposure on ventral pallidal representations of sucrose cues. Decoding of cue identity based on ventral pallidum firing was blunted for the Pavlovian alcohol cue in comparison to both the instrumental cue trained with alcohol and either cue type trained with sucrose. Further, non‐associative alcohol exposure had opposing effects on ventral pallidal encoding of sucrose cues trained on instrumental versus Pavlovian associations, enhancing decoding accuracy for an instrumental discriminative stimulus and reducing decoding accuracy for a Pavlovian conditioned stimulus. These findings suggest that alcohol exposure can drive biased engagement of specific reward‐related signals in the ventral pallidum. -
Introduction Impulsivity is a symptom of attention-deficit/hyperactivity disorder (ADHD) and variants in the Lphn3 (Adgrl3 ) gene (OMIM 616417) have been linked to ADHD. This project utilized a delay-discounting (DD) task to examine the impact of Lphn3 deletion in rats on impulsive choice. “Positive control” measures were also collected in spontaneously hypertensive rats (SHRs), another animal model of ADHD. Methods For Experiment I, rats were given the option to press one lever for a delayed reward of 3 food pellets or the other lever for an immediate reward of 1 pellet. Impulsive choice was measured as the tendency to discount the larger, delayed reward. We hypothesized that impulsive choice would be greater in the SHR and Lphn3 knockout (KO) rats relative to their control strains - Wistar-Kyoto (WKY) and Lphn3 wildtype (WT) rats, respectively. Results The results did not completely support the hypothesis, as only the SHRs (but not the Lphn3 KO rats) demonstrated a decrease in the percent choice for the larger reward. Because subsequent trials did not begin until the end of the delay period regardless of which lever was selected, rats were required to wait for the next trial to start even if they picked the immediate lever. Experiment II examined whether the rate of reinforcement influenced impulsive choice by using a DD task that incorporated a 1 s inter-trial interval (ITI) immediately after delivery of either the immediate (1 pellet) or delayed (3 pellet) reinforcer. The results of Experiment II found no difference in the percent choice for the larger reward between Lphn3 KO and WT rats, demonstrating reinforcement rate did not influence impulsive choice in Lphn3 KO rats. Discussion Overall, there were impulsivity differences among the ADHD models, as SHRs exhibited deficits in impulsive choice, while the Lphn3 KO rats did not.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- The DOI is not currently available.
