An official website of the United States government
The acquisition of instrumental responding can be supported by primary reinforcers or by conditional (also known as secondary) reinforcers that themselves have an association to a primary reinforcer. While primary reinforcement has been heavily studied for the past century, the associative basis of conditioned reinforcement has received comparatively little experimental examination. Yet conditioned reinforcement has been employed as an important behavioral assay in neuroscience studies, and thus an analysis of its associative basis is called for. We evaluated the extent to which an element from a previously trained compound would facilitate conditioned reinforcement. Three groups of rats received Pavlovian conditioning with a visual-auditory compound cue followed by food. After training, a lever was made available that, when pressed, produced the same trained compound (group compound), only the auditory cue (group element), or a novel auditory cue (group control). The rats in group compound pressed the lever at a higher rate than did rats in either group element or group control, demonstrating a strong conditioned reinforcement effect only in group compound. Interestingly, there was almost no difference in responding between group element and group control. The implications of this generalization decrement in conditioned reinforcement are discussed—particularly as they relate to research in behavioral neuroscience.
more »
« less
Elements of a Compound Elicit Little Conditioned Reinforcement
The acquisition of instrumental responding can be supported by primary reinforcers or by conditional (also known as secondary) reinforcers that themselves have an association to a primary reinforcer. While primary reinforcement has been heavily studied for the past century, the associative basis of conditioned reinforcement has received comparatively little experimental examination. Yet conditioned reinforcement has been employed as an important behavioral assay in neuroscience studies, and thus an analysis of its associative basis is called for. We evaluated the extent to which an element from a previously trained compound would facilitate conditioned reinforcement. Three groups of rats received Pavlovian conditioning with a visual-auditory compound cue followed by food. After training, a lever was made available that, when pressed, produced the same trained compound (group compound), only the auditory cue (group element), or a novel auditory cue (group control). The rats in group compound pressed the lever at a higher rate than did rats in either group element or group control, demonstrating a strong conditioned reinforcement effect only in group compound. Interestingly, there was almost no difference in responding between group element and group control. The implications of this generalization decrement in conditioned reinforcement are discussed—particularly as they relate to research in behavioral neuroscience.
more »
« less
- Award ID(s):
- 1844144
- PAR ID:
- 10288526
- Date Published:
- Journal Name:
- Journal of experimental psychology
- ISSN:
- 0278-7393
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Humans and other animals are capable of reasoning. However, there are overwhelming examples of errors or anomalies in reasoning. In two experiments, we studied if rats, like humans, estimate the conjunction of two events as more likely than each event independently, a phenomenon that has been called conjunction fallacy. In both experiments, rats learned through food reinforcement to press a lever under some cue conditions but not others. Sound B was rewarded whereas Sound A was not. However, when B was presented with the visual cue Y was not rewarded, whereas AX was rewarded (i.e., A-, AX+, B+, BY-). Both visual cues were presented in the same bulb. After training, rats received test sessions in which A and B were presented with the bulb explicitly off or occluded by a metal piece. Thus, on the occluded condition, it was ambiguous whether the trials were of the elements alone (A or B) or of the compounds (AX or BY). Rats responded on the occluded condition as if the compound cues were most likely present. The second experiment investigated if this error in probability estimation in Experiment 1, could be due to a conjunction fallacy, and if this could be attenuated by increasing the ratio of element/compound trials from the original 50-50 to 70-30 and 90-10. Only the 90-10 condition (where 90% of the training trials were of just A or just B) did not show a conjunction fallacy, though it emerged in all groups with additional training. These findings open new avenues for exploring the mechanisms behind the conjunction fallacy effect.more » « less
-
Introduction: Impulsivity is a symptom of Attention-Deficit/Hyperactivity Disorder (ADHD) and variants in the Lphn3 (Adgrl3) gene [OMIM 616417] have been linked to ADHD. This project utilized a delay-discounting (DD) task to examine the impact of Lphn3 deletion in rats on impulsive choice. “Positive control” measures were also collected in Spontaneously Hypertensive Rats (SHRs), another animal model of ADHD. Methods: For Experiment I, rats were given the option to press one lever for a delayed reward of 3 food pellets or the other lever for an immediate reward of 1 pellet. Impulsive choice was measured as the tendency to discount the larger, delayed reward. We hypothesized that impulsive choice would be greater in the SHR and Lphn3 knockout (KO) rats relative to their control strains - Wistar-Kyoto (WKY) and Lphn3 wildtype (WT) rats, respectively. Results: The results did not completely support the hypothesis, as only the SHRs (but not the Lphn3 KO rats) demonstrated a decrease in the percent choice for the larger reward. Because subsequent trials did not begin until the end of the delay period regardless of which lever was selected, rats were required to wait for the next trial to start even if they picked the immediate lever. Experiment II examined whether the rate of reinforcement influenced impulsive choice by using a DD task that incorporated a 1 sec inter-trial interval (ITI) immediately after delivery of either the immediate (1 pellet) or delayed (3 pellet) reinforcer. The results of Experiment II found no difference in the percent choice for the larger reward between Lphn3 KO and WT rats, demonstrating reinforcement rate did not influence impulsive choice in Lphn3 KO rats. Discussion: Overall, there were impulsivity differences among the ADHD models, as SHRs exhibited deficits in impulsive choice, while the Lphn3 KO rats did not.more » « less
-
The ability to acquire information about the environment through social observation or instruction is an essential form of learning in humans and other animals. Here, we assessed the ability of rats to acquire an association between a light stimulus and the presentation of a reward that is either hidden (sucrose solution) or visible (food pellet) via observation of a trained demonstrator. Subsequent training of observers on the light-reward association indicated that while observation alone was not sufficient for observers to acquire the association, contact with the reward location was higher in observers that were paired with a demonstrator. However, this was only true when the light cue predicted a sucrose reward. Additionally, we found that in the visible reward condition, levels of demonstrator orienting and food cup contact during the observation period tended to be positively correlated with the corresponding behaviour of their observer. This relationship was only seen during later sessions of observer training. Together, these results suggest that while our models were not sufficient to induce associative learning through observation alone, demonstrator behaviour during observation did influence how their paired observer's behavioural response to the cue evolved over the course of direct individual training.more » « less
-
null (Ed.)Opioid use disorder (OUD) is a debilitating disorder that affects millions of people. Neutral cues can acquire motivational properties when paired with the positive emotional effects of drug intoxication to stimulate relapse. However, much less research has been devoted to cues that become conditioned to the aversive effects of opioid withdrawal. We argue that environmental stimuli promote motivation for opioids when cues are paired with withdrawal (conditioned withdrawal) and generate opioid consumption to terminate conditioned withdrawal (conditioned negative reinforcement). We review evidence that cues associated with pain drive opioid consumption, as patients with chronic pain may misuse opioids to escape physical and emotional pain. We highlight sex differences in withdrawal-induced stress reactivity and withdrawal cue processing and discuss neurocircuitry that may underlie withdrawal cue processing in dependent individuals. These studies highlight the importance of studying cues associated with withdrawal in dependent individuals and point to areas for exploration in OUD research.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- The DOI is not currently available.
