Prediction error as a linear function of reward probability is coded in human nucleus accumbens

Abler, Birgit; Walter, Henrik; Erk, Susanne; Kammerer, Hannes; Spitzer, Manfred

doi:10.1016/j.neuroimage.2006.01.001

Cited by 355 publications

(327 citation statements)

References 25 publications

Supporting

Mentioning

282

Contrasting

Unclassified

Order By: Relevance

“…As expected (Abler et al, 2005(Abler et al, ,2006, reaction times in the controls (no/low/high reward: 715/718/684 ms) were significantly faster in the high reward trials than in the low (p<0.005) or the no reward trials than in the low (p>0.05) (Figure 1). This main effect of reward was seen in the schizophrenia group as well (no/low/high reward: 780/778/746 ms; p<0.03 for low and p<0.01 for no reward trials), but was attenuated and not significant in the manic group (no/low/high: 839/835/812 ms).…”

Section: Accuracy and Reaction Time Datasupporting

confidence: 69%

“…Statistical maps were thresholded at p<0.001 for the voxelwise analysis comprising all subjects, and p<0.005 for all other voxel-wise within and between group comparisons. In a priori ROI of the mesolimbic reward system (ie the ventral striatum (Abler et al, 2005(Abler et al, ,2006Knutson and Cooper, 2005;Knutson et al, 2001b) and the tegmental area/brain stem (Dreher et al, 2006)) the p-values were corrected for the number of comparisons made within each region using the small volume correction procedure (Worsley et al,1996). A priori volumes of interest were derived from a previous pharmacofMRI experiment in healthy subjects with the same task from the trials without medication (Abler et al, 2007).…”

Section: Fmri Analysismentioning

confidence: 99%

“…The clear link between activation of the dopaminergic mesolimbic system and reward functions (Abler et al, 2005(Abler et al, ,2006Knutson and Cooper, 2005;Knutson et al, 2001b) led us to study this system in mania. Besides anticipatory dopamine signals, we were interested in prediction error signals mediated by dopamine upon receipt and omission ofreward (Abler et al, 2005(Abler et al, ,2006.…”

Section: Introductionmentioning

confidence: 99%

“…Besides anticipatory dopamine signals, we were interested in prediction error signals mediated by dopamine upon receipt and omission ofreward (Abler et al, 2005(Abler et al, ,2006. As the symptoms of untreated acute mania (including hyperactivity, excitement, and impaired decision-making capability) are not easily compatible with an fMRI study, we decided to investigate only medicated patients.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Abnormal Reward System Activation in Mania

Abler

Greenhouse

Öngür

et al. 2007

Neuropsychopharmacol

Self Cite

195

137

View full text Add to dashboard Cite

Transmission of reward signals is a function of dopamine, a neurotransmitter known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), we investigated how expectation and receipt of monetary rewards modulate brain activation in patients with bipolar mania and schizophrenia. We studied 12 acutely manic patients with a history of bipolar disorder, 12 patients with a current episode of schizoaffective disorder or schizophrenia and 12 healthy subjects. All patients were treated with dopamine antagonists at the time of the study. Subjects performed a delayed incentive paradigm with monetary reward in the scanner that allowed for investigating effects of expectation, receipt, and omission of rewards. Patients with schizophrenia and healthy control subjects showed the expected activation of dopaminergic brain areas, that is, ventral tegmentum activation upon expectation of monetary rewards and nucleus accumbens activation during receipt vs omission of rewards. In manic patients, however, we did not find a similar pattern of brain activation and the differential signal in the nucleus accumbens upon receipt vs omission of rewards was significantly lower compared to the healthy control subjects. Our findings provide evidence for abnormal function of the dopamine system during receipt or omission of expected rewards in bipolar disorder. These deficits in prediction error processing in acute mania may help to explain symptoms of disinhibition and abnormal goal pursuit regulation.

show abstract

Section: Accuracy and Reaction Time Datasupporting

confidence: 69%

Section: Fmri Analysismentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Abnormal Reward System Activation in Mania

Abler

Greenhouse

Öngür

et al. 2007

Neuropsychopharmacol

Self Cite

195

137

View full text Add to dashboard Cite

show abstract

“…In humans, functional MRI (fMRI) studies and even in vivo surgical recordings (Zaghloul et al, 2009) have reported correlates of prediction-error signals in the striatum that resemble those of dopamine neurons recorded in animals, including phasic (event-related) positive and negative prediction error responses (McClure et al, 2003a;O'Doherty et al, 2003;D'Ardenne et al, 2008) that reflect probability (e.g. Abler et al 2006;Burke et al 2010;Spicer et al 2007;Tobler et al 2007) and more specific predictions of formal learning theories Kahnt et al, 2012;Rutledge et al, 2010;Tobler et al, 2007). However, it is worth keeping in mind that the haemodynamic response measured with neuroimaging is nonspecific rather than a one-to-one reflection of a particular neural event such as dopamine release (see also Düzel et al 2009), which could explain why some fMRI studies have suggested positive coding of losses (Seymour et al 2004; although see also Tom et al 2007) and a dominance of action over value (Guitart-Masip et al, 2012 (Kamin, 1969) used an aversive between-subjects design; by contrast, the experiment described in the text and depicted in abbreviated form here (Waelti et al, 2001) used an appetitive within-subject design where the test consists of a comparison between Y and X (see also Figure 2A); The optogenetic unblocking experiment of Steinberg et al (2013) used a between-subject design.…”

Section: Phasic Dopamine Signals Represent Model-free Prediction Errorsmentioning

confidence: 99%

The role of learning-related dopamine signals in addiction vulnerability

Huys

Tobler

Hasler

et al. 2014

Progress in Brain Research

View full text Add to dashboard Cite

Psychostimulants such as methylphenidate (MPH) and antidepressants such as fluoxetine (FLX) are widely used in the treatment of various mental disorders or as cognitive enhancers. These medications are often combined, for example, to treat comorbid disorders. There is a considerable body of evidence from animal models indicating that individually these psychotropic medications can have detrimental effects on the brain and behavior, especially when given during sensitive periods of brain development. However, almost no studies investigate possible interactions between these drugs. This is surprising given that their combined neurochemical effects (enhanced dopamine and serotonin neurotransmission) mimic some effects of illicit drugs such as cocaine and amphetamine. Here, we summarize recent studies in juvenile rats on the molecular effects in the mid-and forebrain and associated behavioral changes, after such combination treatments. Our findings indicate that these combined MPH + FLX treatments can produce similar molecular changes as seen after cocaine exposure while inducing behavioral changes indicative of dysregulated mood and motivation, effects that often endure into adulthood. Tables: 2 References: 254 ABSTRACT Dopaminergic signals play a mathematically precise role in reward-related learning, and variations in dopaminergic signalling have been implicated in vulnerability to addiction. Here, we provide a detailed overview of the relationship between theoretical, mathematical and experimental accounts of phasic dopamine signalling, with implications for the role of learning-related dopamine signalling in addiction and related disorders. We describe the theoretical and behavioural characteristics of model-free learning based on errors in the prediction of reward, including step-by-step explanations of the underlying equations. We then use recent insights from an animal model that highlights individual variation in learning during a Pavlovian conditioning paradigm to describe overlapping aspects of incentive salience attribution and model-free learning. We argue that this provides a computationally coherent account of some features of addiction. CONTENTS

show abstract

Altered Reward Processing in Adolescents With Prenatal Exposure to Maternal Cigarette Smoking

Müller¹

2013

JAMA Psychiatry

View full text Add to dashboard Cite

; for the IMAGEN Consortium IMPORTANCE Higher rates of substance use and dependence have been observed in the offspring of mothers who smoked during pregnancy. Animal studies indicate that prenatal exposure to nicotine alters the development of brain areas related to reward processing, which might be a risk factor for substance use and addiction later in life. However, no study has examined the effect of maternal smoking on the offspring's brain response during reward processing. OBJECTIVE To determine whether adolescents with prenatal exposure to maternal cigarette smoking differ from their nonexposed peers in the response of the ventral striatum to the anticipation or the receipt of a reward. DESIGN An observational case-control study. SETTING Data were obtained from the IMAGEN Study, a European multicenter study of impulsivity, reinforcement sensitivity, and emotional reactivity in adolescents. The IMAGEN sample consists of 2078 healthy adolescents (age range, 13-15 years) recruited from March 1, 2008, through December 31, 2011, in local schools. PARTICIPANTS We assessed an IMAGEN subsample of 177 adolescents with prenatal exposure to maternal cigarette smoking and 177 nonexposed peers (age range, 13-15 years) matched by sex, maternal educational level, and imaging site. MAIN OUTCOME AND MEASURE Response to reward in the ventral striatum measured with functional magnetic resonance imaging. RESULTS In prenatally exposed adolescents, we observed a weaker response in the ventral striatum during reward anticipation (left side, F = 14.98 [P < .001]; right side, F = 15.95 [P < .001]) compared with their nonexposed peers. No differences were found regarding the responsivity of the ventral striatum to the receipt of a reward (left side, F = 0.21 [P = .65]; right side, F = 0.47 [P = .49]). CONCLUSIONS The weaker responsivity of the ventral striatum to reward anticipation in prenatally exposed adolescents may represent a risk factor for substance use and development of addiction later in life. This result highlights the need for education and preventive measures to reduce smoking during pregnancy. Future analyses should assess whether prenatally exposed adolescents develop an increased risk for substance use and addiction and which role the reported neuronal differences during reward anticipation plays in this development.

show abstract

Prediction error as a linear function of reward probability is coded in human nucleus accumbens

Cited by 355 publications

References 25 publications

Abnormal Reward System Activation in Mania

Abnormal Reward System Activation in Mania

The role of learning-related dopamine signals in addiction vulnerability

Altered Reward Processing in Adolescents With Prenatal Exposure to Maternal Cigarette Smoking

Contact Info

Product

Resources

About