What can the monetary incentive delay task tell us about the neural processing of reward and punishment?

References

• Thorndike EL. Human Learning. New York, NY, USA: Century Co, Messenger Lectures, Cornell University Series 5; 1931.
   Google Scholar
• Domjan MP. Principles of Learning and Behavior. CengageBrain.com. 2009.
   Google Scholar
• Miltenberger RG. Behavior Modification: Principles and Procedures. CengageBrain.com. 2011.
   Google Scholar
• Hollerman JR, Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci. 1998;1(4):304–309.
   PubMed Web of Science ®Google Scholar
• Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol. 1998;80(1):1–27.
   PubMed Web of Science ®Google Scholar
• Schultz W. Behavioral theories and the neurophysiology of reward. Annu Rev Psychol. 2006;57:87–115.
   PubMed Web of Science ®Google Scholar
• Delgado MR, Nystrom LE, Fissell C, Noll DC, Fiez JA. Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol. 2000;84(6):3072–3077.
   PubMed Web of Science ®Google Scholar
• Knutson B, Westdorp A, Kaiser E, Hommer D. FMRI visualization of brain activity during a monetary incentive delay task. Neuroimage. 2000;12(1):20–27.
   PubMed Web of Science ®Google Scholar
• Haber SN, Knutson B. The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology. 2010;35(1):4–26.
   PubMed Web of Science ®Google Scholar
• Elliott R, Friston KJ, Dolan RJ. Dissociable neural responses in human reward systems. J Neurosci. 2000;20(16):6159–6165.
   PubMed Web of Science ®Google Scholar
• Craig W. Appetites and aversions as constituents of instincts. Proc Natl Acad Sci U S A. 1917;3(12):685–688.
   PubMedGoogle Scholar
• Knutson B, Fong GW, Adams CM, Varner JL, Hommer D. Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport. 2001;12(17):3683–3687.
   PubMed Web of Science ®Google Scholar
• Schultz W, Tremblay L, Hollerman JR. Reward processing in primate orbitofrontal cortex and basal ganglia. Cereb Cortex. 2000;10(3):272–284.
   PubMed Web of Science ®Google Scholar
• Breiter HC, Aharon I, Kahneman D, Dale A, Shizgal P. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron. 2001;30:619–639.
   PubMed Web of Science ®Google Scholar
• O’Doherty JP, Deichmann R, Critchley HD, Dolan RJ. Neural responses during anticipation of a primary taste reward. Neuron. 2002;33(5):815–826.
   PubMed Web of Science ®Google Scholar
• Knutson B, Fong GW, Bennett SM, Adams CM, Hommer D. A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI. Neuroimage. 2003;18(2):263–272.
   PubMed Web of Science ®Google Scholar
• Rademacher L, Krach S, Kohls G, Irmak A, Gründer G, Spreckelmeyer KN. Dissociation of neural networks for anticipation and consumption of monetary and social rewards. Neuroimage. 2010;49(4):3276–3285.
   PubMed Web of Science ®Google Scholar
• Delgado MR, Locke HM, Stenger VA, Fiez JA. Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations. Cogn Affect Behav Neurosci. 2003;3(1):27–38.
   PubMed Web of Science ®Google Scholar
• Delgado MR, Stenger VA, Fiez JA. Motivation-dependent responses in the human caudate nucleus. Cereb Cortex. 2004;14(9):1022–1030.
   PubMed Web of Science ®Google Scholar
• O’Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ. Temporal difference models and reward-related learning in the human brain. Neuron. 2003;38(2):329–337.
   PubMed Web of Science ®Google Scholar
• Knutson B, Wimmer GE. Splitting the difference: how does the brain code reward episodes? Ann N Y Acad Sci. 2007;1104:54–69.
   PubMed Web of Science ®Google Scholar
• Pagnoni G, Zink CF, Montague PR, Berns GS. Activity in human ventral striatum locked to errors of reward prediction. Nat Neurosci. 2002;5(2):97–98.
   PubMed Web of Science ®Google Scholar
• Doñamayor N, Schoenfeld MA, Münte TF. Magneto- and electroencephalographic manifestations of reward anticipation and delivery. Neuroimage. 2012;62(1):17–29.
   PubMed Web of Science ®Google Scholar
• Bunzeck N, Guitart-Masip M, Dolan RJ, Düzel E. Contextual novelty modulates the neural dynamics of reward anticipation. J Neurosci. 2011;31:12816–12822.
   PubMed Web of Science ®Google Scholar
• Kawasaki M, Yamaguchi Y. Frontal theta and beta synchronizations for monetary reward increase visual working memory capacity. Soc Cogn Affect Neurosci. 2013;8(5):523–530.
   PubMed Web of Science ®Google Scholar
• Rogers RD, Ramnani N, Mackay C, et al. Distinct portions of anterior cingulate cortex and medial prefrontal cortex are activated by reward processing in separable phases of decision-making cognition. Biol Psychiatry. 2004;55(6):594–602.
   PubMed Web of Science ®Google Scholar
• Ramnani N, Elliott R, Athwal BS, Passingham RE. Prediction error for free monetary reward in the human prefrontal cortex. Neuroimage. 2004;23(3):777–786.
   PubMed Web of Science ®Google Scholar
• Yacubian J, Gläscher J, Schroeder K, Sommer T, Braus DF, Büchel C. Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. J Neurosci. 2006;26(37):9530–9537.
   PubMed Web of Science ®Google Scholar
• Ramnani N, Miall RC. Instructed delay activity in the human prefrontal cortex is modulated by monetary reward expectation. Cereb Cortex. 2003;13(3):318–327.
   PubMed Web of Science ®Google Scholar
• O’Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science. 2004;304(5669):452–454.
   PubMed Web of Science ®Google Scholar
• Tricomi EM, Delgado MR, Fiez JA. Modulation of caudate activity by action contingency. Neuron. 2004;41(2):281–292.
   PubMed Web of Science ®Google Scholar
• Gläscher J, Hampton AN, O’Doherty JP. Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb Cortex. 2009;19(2):483–495.
   PubMed Web of Science ®Google Scholar
• FitzGerald TH, Friston KJ, Dolan RJ. Action-specific value signals in reward-related regions of the human brain. J Neurosci. 2012;32(46):16417a–16423a.
   PubMed Web of Science ®Google Scholar
• Palminteri S, Boraud T, Lafargue G, Dubois B, Pessiglione M. Brain hemispheres selectively track the expected value of contralateral options. J Neurosci. 2009;29(43):13465–13472.
   PubMed Web of Science ®Google Scholar
• Wunderlich K, Rangel A, O’Doherty JP. Neural computations underlying action-based decision making in the human brain. Proc Natl Acad Sci U S A. 2009;106(40):17199–17204.
   PubMed Web of Science ®Google Scholar
• Poldrack RA, Clark J, Paré-Blagoev EJ, et al. Interactive memory systems in the human brain. Nature. 2001;414(6863):546–550.
   PubMed Web of Science ®Google Scholar
• Aron AR, Shohamy D, Clark J, Myers C, Gluck MA, Poldrack RA. Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. J Neurophysiol. 2004;92:1144–1152.
   PubMed Web of Science ®Google Scholar
• Tricomi E, Delgado MR, McCandliss BD, McClelland JL, Fiez JA. Performance feedback drives caudate activation in a phonological learning task. J Cogn Neurosci. 2006;18(6):1029–1043.
   PubMed Web of Science ®Google Scholar
• Tricomi E, Fiez JA. Feedback signals in the caudate reflect goal achievement on a declarative memory task. Neuroimage. 2008;41(3):1154–1167.
   PubMed Web of Science ®Google Scholar
• Nees F, Vollstädt-Klein S, Fauth-Bühler M, et al. A target sample of adolescents and reward processing: same neural and behavioral correlates engaged in common paradigms? Exp Brain Res. 2012;223(3):429–439.
   PubMed Web of Science ®Google Scholar
• Donkers FC, Nieuwenhuis S, van Boxtel GJ. Mediofrontal negativities in the absence of responding. Brain Res Cogn Brain Res. 2005;25(3):777–787.
   PubMedGoogle Scholar
• Zhou Z, Yu R, Zhou X. To do or not to do? Action enlarges the FRN and P300 effects in outcome evaluation. Neuropsychologia. 2010;48(12):3606–3613.
   PubMed Web of Science ®Google Scholar
• Lutz K, Pedroni A, Nadig K, Luechinger R, Jäncke L. The rewarding value of good motor performance in the context of monetary incentives. Neuropsychologia. 2012;50(8):1739–1747.
   PubMed Web of Science ®Google Scholar
• Daniel R, Pollmann S. Comparing the neural basis of monetary reward and cognitive feedback during information-integration category learning. J Neurosci. 2010;30(1):47–55.
   PubMed Web of Science ®Google Scholar
• Koepp MJ, Gunn RN, Lawrence AD, et al. Evidence for striatal dopamine release during a video game. Nature. 1998;393(6682):266–268.
   PubMed Web of Science ®Google Scholar
• Kätsyri J, Hari R, Ravaja N, Nummenmaa L. Just watching the game ain’t enough: striatal fMRI reward responses to successes and failures in a video game during active and vicarious playing. Front Hum Neurosci. 2013;7:278.
   PubMed Web of Science ®Google Scholar
• Ryan RM, Deci EL. Intrinsic and extrinsic motivations: classic definitions and new directions. Contemp Educ Psychol. 2000;25(1):54–67.
   PubMed Web of Science ®Google Scholar
• Frey BS. How intrinsic motivation is crowded out and in. Rationality and Society. 1994;6:334–352.
   Web of Science ®Google Scholar
• Frey BS, Jegen R. Motivation crowding theory. J Econ Surv. 2001;15:589–611.
   Web of Science ®Google Scholar
• Holroyd CB, Nieuwenhuis S, Yeung N, et al. Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals. Nat Neurosci. 2004;7(5):497–498.
   PubMed Web of Science ®Google Scholar
• Klein TA, Neumann J, Reuter M, Hennig J, von Cramon DY, Ullsperger M. Genetically determined differences in learning from errors. Science. 2007;318(5856):1642–1645.
   PubMed Web of Science ®Google Scholar
• Ullsperger M, von Cramon DY. Error monitoring using external feedback: specific roles of the habenular complex, the reward system, and the cingulate motor area revealed by functional magnetic resonance imaging. J Neurosci. 2003;23(10):4308–4314.
   PubMed Web of Science ®Google Scholar
• Holroyd CB, Krigolson OE, Baker R, Lee S, Gibson J. When is an error not a prediction error? An electrophysiological investigation. Cogn Affect Behav Neurosci. 2009;9(1):59–70.
   PubMed Web of Science ®Google Scholar
• Wolpert DM, Ghahramani Z, Jordan MI. An internal model for sensorimotor integration. Science. 1995;269(5232):1880–1882.
   PubMed Web of Science ®Google Scholar
• Lutz K, Puorger R, Cheetham M, Jancke L. Development of ERN together with an internal model of audio-motor associations. Front Hum Neurosci. 2013;7:471.
   PubMed Web of Science ®Google Scholar
• Kaplan F, Oudeyer PY. In search of the neural circuits of intrinsic motivation. Front Neurosci. 2007;1(1):225–236.
   PubMed Web of Science ®Google Scholar
• Bunzeck N. Contextual interaction between novelty and reward processing within the mesolimbic system. Human Brain Mapping. 2012;33:1309–1324.
   PubMed Web of Science ®Google Scholar
• Guitart-Masip M, Bunzeck N, Stephan KE, Dolan RJ, Düzel E. Contextual novelty changes reward representations in the striatum. J Neurosci. 2010;30(5):1721–1726.
   PubMed Web of Science ®Google Scholar
• Peters J, Büchel C. The neural mechanisms of inter-temporal decision-making: understanding variability. Trends Cogn Sci. 2011;15(5):227–239.
   PubMed Web of Science ®Google Scholar
• Bickel WK, Miller ML, Yi R, Kowal BP, Lindquist DM, Pitcock JA. Behavioral and neuroeconomics of drug addiction: competing neural systems and temporal discounting processes. Drug Alcohol Depend. 2007;90(Suppl 1):S85–S91.
   PubMed Web of Science ®Google Scholar
• Businelle MS, McVay MA, Kendzor D, Copeland Amy. A comparison of delay discounting among smokers, substance abusers, and non-dependent controls. Drug and Alcohol Dependence 2010;112(3):S247–S250.
   PubMed Web of Science ®Google Scholar
• Diekhof EK, Falkai P, Gruber O. Functional neuroimaging of reward processing and decision-making. A review of aberrant motivational and affective processing in addiction and mood disorders. Brain Res Rev. 2008;59(1):164–184.
   PubMedGoogle Scholar
• Stacey D, Bilbao A, Maroteaux M, et al. RASGRF2 regulates alcohol-induced reinforcement by influencing mesolimbic dopamine neuron activity and dopamine release. Proc Natl Acad Sci U S A. 2012;109(51):21128–21133.
   PubMed Web of Science ®Google Scholar
• Schumann G, Coin LJ, Lourdusamy A. Genome-wide association and genetic functional studies identify autism susceptibility candidate 2 gene (AUTS2) in the regulation of alcohol consumption. Proc Natl Acad Sci U S A. 2011;108(17):7119–7124.
   PubMed Web of Science ®Google Scholar
• Filbey FM, Dunlop J, Myers US. Neural Effects of Positive and Negative Incentives during Marijuana Withdrawal. PLoS One 2013;8(5):e61470.
   PubMed Web of Science ®Google Scholar
• Jager G, Block RI, Luijten M, Ramsey NF. Tentative evidence for striatal hyperactivity in adolescent cannabis-using boys. a cross-sectional multicenter fMRI study. J Psychoactive Drugs 2013;45(2):156–167.
   PubMed Web of Science ®Google Scholar
• Nestor L, Hester R, Garavan H. Increased ventral striatal BOLD activity during non-drug reward anticipation in cannabis users. NeuroImage 2010;49(1):1133–1143
   PubMed Web of Science ®Google Scholar
• Bjork JM, Momenan R, Smith AR, Hommer DW. Reduced posterior mesofrontal cortex activation by risky rewards in substance-dependent patients. Drug Alcohol Depend. 2008;95(1–2):115–128.
   PubMed Web of Science ®Google Scholar
• Patel KT, Stevens MC, Meda SA, et al. Robust changes in reward circuitry during reward loss in current and former cocaine users during performance of a monetary incentive delay task. Biol Psychiatry. 2013;74(7):529–537.
   PubMed Web of Science ®Google Scholar
• Villafuerte S, Heitzeg MM, Foley S, et al. Impulsiveness and insula activation during reward anticipation are associated with genetic variants in GABRA2 in a family sample enriched for alcoholism. Mol Psychiatry. 2012;17(5):511–519.
   PubMed Web of Science ®Google Scholar
• Ströhle A, Stoy M, Wrase J, et al. Reward anticipation and outcomes in adult males with attention-deficit/hyperactivity disorder. Neuroimage. 2008;39(3):966–972.
   PubMed Web of Science ®Google Scholar
• Stoy M, Schlagenhauf F, Schlochtermeier L, et al. Reward processing in male adults with childhood ADHD – a comparison between drug-naïve and methylphenidate-treated subjects. Psychopharmacology (Berl). 2011;215(3):467–481.
   PubMed Web of Science ®Google Scholar
• Demurie E, Roeyers H, Wiersema JR, Sonuga-Barke E. No evidence for inhibitory deficits or altered reward processing in ADHD: data from a new integrated monetary incentive delay go/no-go task. J Atten Disord. February 4, 2013. [Epub ahead of print.]
   PubMedGoogle Scholar
• Demurie E, Roeyers H, Baeyens D, Sonuga-Barke E. Common alterations in sensitivity to type but not amount of reward in ADHD and autism spectrum disorders. J Child Psychol Psychiatry. 2011;52(11):1164–1173.
   PubMed Web of Science ®Google Scholar
• Schlagenhauf F, Juckel G, Koslowski M, et al. Reward system activation in schizophrenic patients switched from typical neuroleptics to olanzapine. Psychopharmacology (Berl). 2008;196(4):673–684.
   PubMed Web of Science ®Google Scholar
• Nielsen MO, Rostrup E, Wulff S, et al. Improvement of brain reward abnormalities by antipsychotic monotherapy in schizophrenia. Arch Gen Psychiatry. 2012;69(12):1195–1204.
   PubMed Web of Science ®Google Scholar
• Simon JJ, Biller A, Walther S, et al. Neural correlates of reward processing in schizophrenia – relationship to apathy and depression. Schizophr Res. 2010;118(1–3):154–161.
   PubMed Web of Science ®Google Scholar
• Nielsen MØ, Rostrup E, Wulff S, et al. Alterations of the brain reward system in antipsychotic naïve schizophrenia patients. Biol Psychiatry. 2012;71(10):898–905.
   PubMed Web of Science ®Google Scholar
• Waltz JA, Schweitzer JB, Ross TJ, et al. Abnormal responses to monetary outcomes in cortex, but not in the basal ganglia, in schizophrenia. Neuropsychopharmacology. 2010;35(12):2427–2439.
   PubMed Web of Science ®Google Scholar
• White TP, Gilleen J, Shergill SS. Dysregulated but not decreased salience network activity in schizophrenia. Front Hum Neurosci. 2013;7:65.
   PubMed Web of Science ®Google Scholar
• Zhang WN, Chang SH, Guo LY, Zhang KL, Wang J. The neural correlates of reward-related processing in major depressive disorder: a meta-analysis of functional magnetic resonance imaging studies. J Affect Disord. 2013;151(2):531–539.
   PubMed Web of Science ®Google Scholar
• Torrubia R, Ávila C, Moltó J, Caseras X. The Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ) as a measure of Gray’s anxiety and impulsivity dimensions. Personality and Individual Differences. 2001;31(6):837–862.
   Web of Science ®Google Scholar
• Corr PJ. Reinforcement sensitivity theory and personality. Neurosci Biobehav Rev. 2004;28(3):317–332.
   PubMed Web of Science ®Google Scholar
• Beaver JD, Lawrence AD, van Ditzhuijzen J, Davis MH, Woods A, Calder AJ. Individual differences in reward drive predict neural responses to images of food. J Neurosci. 2006;26(19):5160–5166.
   PubMed Web of Science ®Google Scholar
• Camara E, Rodriguez-Fornells A, Münte TF. Microstructural brain differences predict functional hemodynamic responses in a reward processing task. J Neurosci. 2010;30(34):11398–11402.
   PubMed Web of Science ®Google Scholar
• Carter RM, Macinnes JJ, Huettel SA, Adcock RA. Activation in the VTA and nucleus accumbens increases in anticipation of both gains and losses. Front Behav Neurosci. 2009;3:21.
   PubMed Web of Science ®Google Scholar
• Hahn T, Dresler T, Ehlis AC, et al. Neural response to reward anticipation is modulated by Gray’s impulsivity. Neuroimage. 2009;46(4):1148–1153.
   PubMed Web of Science ®Google Scholar
• Barrós-Loscertales A, Meseguer V, Sanjuán A, et al. Striatum gray matter reduction in males with an overactive behavioral activation system. Eur J Neurosci. 2006;24(7):2071–2074.
   PubMed Web of Science ®Google Scholar
• Cohen MX, Schoene-Bake JC, Elger CE, Weber B. Connectivity-based segregation of the human striatum predicts personality characteristics. Nat Neurosci. 2009;12(1):32–34.
   PubMed Web of Science ®Google Scholar
• Hahn T, Dresler T, Ehlis AC, et al. Randomness of resting-state brain oscillations encodes Gray’s personality trait. Neuroimage. 2012;59(2):1842–1845.
   PubMed Web of Science ®Google Scholar
• Costumero V, Barrós-Loscertales A, Bustamante JC, Ventura-Campos N, Fuentes P, Ávila C. Reward sensitivity modulates connectivity among reward brain areas during processing of anticipatory reward cues. Eur J Neurosci. 2013;38(3):2399–2407.
   PubMed Web of Science ®Google Scholar
• Wu CC, Samanez-Larkin GR, Katovich K, Knutson B. Affective traits link to reliable neural markers of incentive anticipation. Neuroimage. 2014;84:279–289.
   PubMed Web of Science ®Google Scholar
• Treadway MT, Buckholtz JW, Zald DH. Perceived stress predicts altered reward and loss feedback processing in medial prefrontal cortex. Front Hum Neurosci. 2013;7:180.
   PubMed Web of Science ®Google Scholar
• Porcelli AJ, Lewis AH, Delgado MR. Acute stress influences neural circuits of reward processing. Front Neurosci. 2012;6:157.
   PubMed Web of Science ®Google Scholar
• Sinha R. Stress and addiction: a dynamic interplay of genes, environment, and drug intake. Biol Psychiatry. 2009;66(2):100–101.
   PubMed Web of Science ®Google Scholar
• Bjork JM, Smith AR, Chen G, Hommer DW. Adolescents, adults and rewards: comparing motivational neurocircuitry recruitment using fMRI. PLoS One. 2010;5(7):e11440.
   PubMed Web of Science ®Google Scholar
• Bjork JM, Smith AR, Chen G, Hommer DW. Psychosocial problems and recruitment of incentive neurocircuitry: exploring individual differences in healthy adolescents. Dev Cogn Neurosci. 2011;1(4):570–577.
   PubMed Web of Science ®Google Scholar
• Ernst M, Nelson EE, Jazbec S, et al. Amygdala and nucleus accumbens in responses to receipt and omission of gains in adults and adolescents. Neuroimage. 2005;25(4):1279–1291.
   PubMed Web of Science ®Google Scholar
• Galvan A, Hare TA, Parra CE, et al. Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents. J Neurosci. 2006;26(25):6885–6892.
   PubMed Web of Science ®Google Scholar
• Vaidya JG, Knutson B, O’Leary DS, Block RI, Magnotta V. Neural sensitivity to absolute and relative anticipated reward in adolescents. PLoS One. 2013;8(3):e58708.
   PubMed Web of Science ®Google Scholar
• Benningfield MM, Blackford JU, Ellsworth ME, et al. Caudate responses to reward anticipation associated with delay discounting behavior in healthy youth. Dev Cogn Neurosci. 2014;7:43–52.
   PubMed Web of Science ®Google Scholar
• Helfinstein SM, Kirwan ML, Benson BE, et al. Validation of a child-friendly version of the monetary incentive delay task. Soc Cogn Affect Neurosci. 2013;8(6):720–726.
   PubMed Web of Science ®Google Scholar
• Kappel V, Koch A, Lorenz RC, et al. CID: a valid incentive delay paradigm for children. J Neural Transm. 2013;120(8):1259–1270.
   PubMed Web of Science ®Google Scholar