Skip to main content

Advertisement

Log in

Reversal learning as a measure of impulsive and compulsive behavior in addictions

  • Review
  • Published:
Psychopharmacology Aims and scope Submit manuscript

Abstract

Background

Our ability to measure the cognitive components of complex decision-making across species has greatly facilitated our understanding of its neurobiological mechanisms. One task in particular, reversal learning, has proven valuable in assessing the inhibitory processes that are central to executive control. Reversal learning measures the ability to actively suppress reward-related responding and to disengage from ongoing behavior, phenomena that are biologically and descriptively related to impulsivity and compulsivity. Consequently, reversal learning could index vulnerability for disorders characterized by impulsivity such as proclivity for initial substance abuse as well as the compulsive aspects of dependence.

Objective

Though we describe common variants and similar tasks, we pay particular attention to discrimination reversal learning, its supporting neural circuitry, neuropharmacology and genetic determinants. We also review the utility of this task in measuring impulsivity and compulsivity in addictions.

Methods

We restrict our review to instrumental, reward-related reversal learning studies as they are most germane to addiction.

Conclusion

The research reviewed here suggests that discrimination reversal learning may be used as a diagnostic tool for investigating the neural mechanisms that mediate impulsive and compulsive aspects of pathological reward-seeking and -taking behaviors. Two interrelated mechanisms are posited for the neuroadaptations in addiction that often translate to poor reversal learning: frontocorticostriatal circuitry dysregulation and poor dopamine (D2 receptor) modulation of this circuitry. These data suggest new approaches to targeting inhibitory control mechanisms in addictions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • American Psychiatric Association (1994) Diagnostic and statistical manual of mental disorders, 4th edn. APA, Washington DC

    Google Scholar 

  • Arnsten AF, Lin CH, Van Dyck CH, Stanhope KJ (1997) The effects of 5-HT3 receptor antagonists on cognitive performance in aged monkeys. Neurobiol Aging 18:21–28

    Article  PubMed  CAS  Google Scholar 

  • Aron AR, Robbins TW, Poldrack RA (2004) Inhibition and the right inferior frontal cortex. Trends Cogn Sci 8:170–177

    Article  PubMed  Google Scholar 

  • Balleine BW, O’Doherty JP (2010) Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35:48–69

    Article  PubMed  Google Scholar 

  • Bannerman DM, Deacon RM, Seeburg PH, Rawlins JN (2003) GluR-A-deficient mice display normal acquisition of a hippocampus-dependent spatial reference memory task but are impaired during spatial reversal. Behav Neurosci 117:866–870

    Article  PubMed  CAS  Google Scholar 

  • Bari A, Theobald DE, Caprioli D, Mar AC, Aidoo-Micah A, Dalley JW, Robbins TW (2010) Serotonin modulates sensitivity to reward and negative feedback in a probabilistic reversal learning task in rats. Neuropsychopharmacology 35:1290–1301

    Article  PubMed  CAS  Google Scholar 

  • Barkus C, Feyder M, Graybeal C, Wright T, Wiedholz L, Izquierdo A, Kiselycznyk C, Schmitt W, Sanderson DJ, Rawlins JN, Saksida LM, Bussey TJ, Sprengel R, Bannerman D, Holmes A (2011) Do GluA1 knockout mice exhibit behavioral abnormalities relevant to the negative or cognitive symptoms of schizophrenia and schizoaffective disorder? Neuropharmacology.

  • Barnes JM, Costall B, Coughlan J, Domeney AM, Gerrard PA, Kelly ME, Naylor RJ, Onaivi ES, Tomkins DM, Tyers MB (1990) The effects of ondansetron, a 5-HT3 receptor antagonist, on cognition in rodents and primates. Pharmacol Biochem Behav 35:955–962

    Article  PubMed  CAS  Google Scholar 

  • Belin D, Mar AC, Dalley JW, Robbins TW, Everitt BJ (2008) High impulsivity predicts the switch to compulsive cocaine-taking. Science 320:1352–1355

    Article  PubMed  CAS  Google Scholar 

  • Birrell JM, Brown VJ (2000) Medial frontal cortex mediates perceptual attentional set shifting in the rat. J Neurosci 20:4320–4324

    PubMed  CAS  Google Scholar 

  • Bissonette GB, Powell EM (2011) Reversal learning and attentional set-shifting in mice. Neuropharmacology.

  • Bissonette GB, Martins GJ, Franz TM, Harper ES, Schoenbaum G, Powell EM (2008) Double dissociation of the effects of medial and orbital prefrontal cortical lesions on attentional and affective shifts in mice. J Neurosci 28:11124–11130

    Article  PubMed  CAS  Google Scholar 

  • Boulougouris V, Robbins TW (2010) Enhancement of spatial reversal learning by 5-HT2C receptor antagonism is neuroanatomically specific. J Neurosci 30:930–938

    Article  PubMed  CAS  Google Scholar 

  • Boulougouris V, Dalley JW, Robbins TW (2007) Effects of orbitofrontal, infralimbic and prelimbic cortical lesions on serial spatial reversal learning in the rat. Behav Brain Res 179:219–228

    Article  PubMed  Google Scholar 

  • Boulougouris V, Castane A, Robbins TW (2008a) Dopamine D2/D3 receptor agonist quinpirole impairs spatial reversal learning in rats: investigation of D3 receptor involvement in persistent behavior. Psychopharmacology (Berl) 202:611–620

    Article  CAS  Google Scholar 

  • Boulougouris V, Glennon JC, Robbins TW (2008b) Dissociable effects of selective 5-HT2A and 5-HT2C receptor antagonists on serial spatial reversal learning in rats. Neuropsychopharmacology 33:2007–2019

    Article  PubMed  CAS  Google Scholar 

  • Brewer JA, Potenza MN (2008) The neurobiology and genetics of impulse control disorders: relationships to drug addictions. Biochem Pharmacol 75:63–75

    Article  PubMed  CAS  Google Scholar 

  • Brigman JL, Mathur P, Harvey-White J, Izquierdo A, Saksida LM, Bussey TJ, Fox S, Deneris E, Murphy DL, Holmes A (2010) Pharmacological or genetic inactivation of the serotonin transporter improves reversal learning in mice. Cereb Cortex 20:1955–1963

    Article  PubMed  Google Scholar 

  • Bussey TJ, Saksida LM, Rothblat LA (2001) Discrimination of computer-graphic stimuli by mice: a method for the behavioral characterization of transgenic and gene-knockout models. Behav Neurosci 115:957–960

    Article  PubMed  CAS  Google Scholar 

  • Bymaster FP, Katner JS, Nelson DL, Hemrick-Luecke SK, Threlkeld PG, Heiligenstein JH, Morin SM, Gehlert DR, Perry KW (2002) Atomoxetine increases extracellular levels of norepinephrine and dopamine in prefrontal cortex of rat: a potential mechanism for efficacy in attention deficit/hyperactivity disorder. Neuropsychopharmacology 27:699–711

    Article  PubMed  CAS  Google Scholar 

  • Castane A, Theobald DE, Robbins TW (2010) Selective lesions of the dorsomedial striatum impair serial spatial reversal learning in rats. Behav Brain Res 210:74–83

    Article  PubMed  Google Scholar 

  • Cheng RK, Etchegaray M, Meck WH (2007) Impairments in timing, temporal memory, and reversal learning linked to neurotoxic regimens of methamphetamine intoxication. Brain Res 1186:255–266

    Article  PubMed  CAS  Google Scholar 

  • Chudasama Y (2011) Animal models of prefrontal-executive function. Behav Neurosci 125:327–343

    Article  PubMed  Google Scholar 

  • Chudasama Y, Robbins TW (2003) Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J Neurosci 23:8771–8780

    PubMed  CAS  Google Scholar 

  • Chudasama Y, Robbins TW (2006) Functions of frontostriatal systems in cognition: comparative neuropsychopharmacological studies in rats, monkeys and humans. Biol Psychol 73:19–38

    Article  PubMed  CAS  Google Scholar 

  • Chudasama Y, Bussey TJ, Muir JL (2001) Effects of selective thalamic and prelimbic cortex lesions on two types of visual discrimination and reversal learning. Eur J Neurosci 14:1009–1020

    Article  PubMed  CAS  Google Scholar 

  • Clarke HF, Dalley JW, Crofts HS, Robbins TW, Roberts AC (2004) Cognitive inflexibility after prefrontal serotonin depletion. Science 304:878–880

    Article  PubMed  CAS  Google Scholar 

  • Clarke HF, Walker SC, Crofts HS, Dalley JW, Robbins TW, Roberts AC (2005) Prefrontal serotonin depletion affects reversal learning but not attentional set shifting. J Neurosci 25:532–538

    Article  PubMed  CAS  Google Scholar 

  • Clarke HF, Walker SC, Dalley JW, Robbins TW, Roberts AC (2007) Cognitive inflexibility after prefrontal serotonin depletion is behaviorally and neurochemically specific. Cereb Cortex 17:18–27

    Article  PubMed  CAS  Google Scholar 

  • Clarke HF, Robbins TW, Roberts AC (2008) Lesions of the medial striatum in monkeys produce perseverative impairments during reversal learning similar to those produced by lesions of the orbitofrontal cortex. J Neurosci 28:10972–10982

    Article  PubMed  CAS  Google Scholar 

  • Clarke HF, Hill GJ, Robbins TW, Roberts AC (2011) Dopamine, but not serotonin, regulates reversal learning in the marmoset caudate nucleus. J Neurosci 31:4290–4297

    Article  PubMed  CAS  Google Scholar 

  • Cools R, Frank MJ, Gibbs SE, Miyakawa A, Jagust W, D’Esposito M (2009) Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration. J Neurosci 29:1538–1543

    Article  PubMed  CAS  Google Scholar 

  • Crews FT, Boettiger CA (2009) Impulsivity, frontal lobes and risk for addiction. Pharmacol Biochem Behav 93:237–247

    Article  PubMed  CAS  Google Scholar 

  • Dalley JW, Fryer TD, Brichard L, Robinson ES, Theobald DE, Laane K, Pena Y, Murphy ER, Shah Y, Probst K, Abakumova I, Aigbirhio FI, Richards HK, Hong Y, Baron JC, Everitt BJ, Robbins TW (2007) Nucleus accumbens D2/3 receptors predict trait impulsivity and cocaine reinforcement. Science 315:1267–1270

    Article  PubMed  CAS  Google Scholar 

  • Dalley JW, Mar AC, Economidou D, Robbins TW (2008) Neurobehavioral mechanisms of impulsivity: fronto-striatal systems and functional neurochemistry. Pharmacol Biochem Behav 90:250–260

    Article  PubMed  CAS  Google Scholar 

  • Dalley JW, Everitt BJ, Robbins TW (2011) Impulsivity, compulsivity, and top-down cognitive control. Neuron 69:680–694

    Article  PubMed  CAS  Google Scholar 

  • De Steno DA, Schmauss C (2009) A role for dopamine D2 receptors in reversal learning. Neuroscience 162:118–127

    Article  PubMed  CAS  Google Scholar 

  • Delatour B, Gisquet-Verrier P (1999) Lesions of the prelimbic–infralimbic cortices in rats do not disrupt response selection processes but induce delay-dependent deficits: evidence for a role in working memory? Behav Neurosci 113:941–955

    Article  PubMed  CAS  Google Scholar 

  • Delatour B, Gisquet-Verrier P (2000) Functional role of rat prelimbic–infralimbic cortices in spatial memory: evidence for their involvement in attention and behavioural flexibility. Behav Brain Res 109:113–128

    Article  PubMed  CAS  Google Scholar 

  • Dias R, Robbins TW, Roberts AC (1996) Primate analogue of the Wisconsin Card Sorting Test: effects of excitotoxic lesions of the prefrontal cortex in the marmoset. Behav Neurosci 110:872–886

    Article  PubMed  CAS  Google Scholar 

  • Diergaarde L, Pattij T, Poortvliet I, Hogenboom F, de Vries W, Schoffelmeer AN, De Vries TJ (2008) Impulsive choice and impulsive action predict vulnerability to distinct stages of nicotine seeking in rats. Biol Psychiatry 63:301–308

    Article  PubMed  CAS  Google Scholar 

  • Divac I, Rosvold HE, Szwarcbart MK (1967) Behavioral effects of selective ablation of the caudate nucleus. J Comp Physiol Psychol 63:184–190

    Article  PubMed  CAS  Google Scholar 

  • Domeney AM, Costall B, Gerrard PA, Jones DN, Naylor RJ, Tyers MB (1991) The effect of ondansetron on cognitive performance in the marmoset. Pharmacol Biochem Behav 38:169–175

    Article  PubMed  CAS  Google Scholar 

  • Eagle DM, Bari A, Robbins TW (2008) The neuropsychopharmacology of action inhibition: cross-species translation of the stop-signal and go/no-go tasks. Psychopharmacology (Berl) 199:439–456

    Article  CAS  Google Scholar 

  • El-Ghundi M, O’Dowd BF, Erclik M, George SR (2003) Attenuation of sucrose reinforcement in dopamine D1 receptor deficient mice. Eur J Neurosci 17:851–862

    Article  PubMed  Google Scholar 

  • Ersche KD, Roiser JP, Robbins TW, Sahakian BJ (2008) Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans. Psychopharmacology (Berl) 197:421–431

    Article  CAS  Google Scholar 

  • Ersche KD, Roiser JP, Abbott S, Craig KJ, Muller U, Suckling J, Ooi C, Shabbir SS, Clark L, Sahakian BJ, Fineberg NA, Merlo-Pich EV, Robbins TW, Bullmore ET (2011) Response perseveration in stimulant dependence is associated with striatal dysfunction and can be ameliorated by a d(2/3) receptor agonist. Biol Psychiatry 70:754–762

    Article  PubMed  CAS  Google Scholar 

  • Evenden JL (1999) Varieties of impulsivity. Psychopharmacology (Berl) 146:348–361

    Article  CAS  Google Scholar 

  • Everitt BJ, Hutcheson DM, Ersche KD, Pelloux Y, Dalley JW, Robbins TW (2007) The orbital prefrontal cortex and drug addiction in laboratory animals and humans. Ann N Y Acad Sci 1121:576–597

    Article  PubMed  CAS  Google Scholar 

  • Evers EA, Cools R, Clark L, van der Veen FM, Jolles J, Sahakian BJ, Robbins TW (2005a) Serotonergic modulation of prefrontal cortex during negative feedback in probabilistic reversal learning. Neuropsychopharmacology 30:1138–1147

    Article  PubMed  CAS  Google Scholar 

  • Evers EA, Tillie DE, van der Veen FM, Lieben CK, Jolles J, Deutz NE, Schmitt JA (2005b) Effects of a novel method of acute tryptophan depletion on plasma tryptophan and cognitive performance in healthy volunteers. Psychopharmacology (Berl) 178:92–99

    Article  CAS  Google Scholar 

  • Fellows LK, Farah MJ (2003) Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. Brain 126:1830–1837

    Article  PubMed  Google Scholar 

  • Fineberg NA, Potenza MN, Chamberlain SR, Berlin HA, Menzies L, Bechara A, Sahakian BJ, Robbins TW, Bullmore ET, Hollander E (2010) Probing compulsive and impulsive behaviors, from animal models to endophenotypes: a narrative review. Neuropsychopharmacology 35:591–604

    Article  PubMed  Google Scholar 

  • Flagel SB, Clark JJ, Robinson TE, Mayo L, Czuj A, Willuhn I, Akers CA, Clinton SM, Phillips PE, Akil H (2011) A selective role for dopamine in stimulus-reward learning. Nature 469:53–57

    Article  PubMed  CAS  Google Scholar 

  • Floresco SB, Block AE, Tse MT (2008) Inactivation of the medial prefrontal cortex of the rat impairs strategy set-shifting, but not reversal learning, using a novel, automated procedure. Behav Brain Res 190:85–96

    Article  PubMed  Google Scholar 

  • Franken IH, van Strien JW, Nijs I, Muris P (2008) Impulsivity is associated with behavioral decision-making deficits. Psychiatry Res 158:155–163

    Article  PubMed  Google Scholar 

  • Ghahremani DG, Monterosso J, Jentsch JD, Bilder RM, Poldrack RA (2010) Neural components underlying behavioral flexibility in human reversal learning. Cereb Cortex 20:1843–1852

    Article  PubMed  Google Scholar 

  • Ghods-Sharifi S, Haluk DM, Floresco SB (2008) Differential effects of inactivation of the orbitofrontal cortex on strategy set-shifting and reversal learning. Neurobiol Learn Mem 89:567–573

    Article  PubMed  Google Scholar 

  • Gisquet-Verrier P, Delatour B (2006) The role of the rat prelimbic/infralimbic cortex in working memory: not involved in the short-term maintenance but in monitoring and processing functions. Neuroscience 141:585–596

    Article  PubMed  CAS  Google Scholar 

  • Graybeal C, Feyder M, Schulman E, Saksida LM, Bussey TJ, Brigman JL, Holmes A (2011) Paradoxical reversal learning enhancement by stress or prefrontal cortical damage: rescue with BDNF. Nature Neurosci. doi:10.1038/nn.2954

  • Groman SM, Jentsch JD (2011) Cognitive control and the dopamine D2-like receptor: a dimensional understanding of addiction. Depress Anxiety. doi:10.1002/da.20897

  • Groman SM, James AS, Jentsch JD (2008) Poor response inhibition: at the nexus between substance abuse and attention deficit/hyperactivity disorder. Neurosci Biobehav Rev

  • Groman SM, Lee B, London ED, Mandelkern MA, James AS, Feiler K, Rivera R, Dahlbom M, Sossi V, Vandervoort E, Jentsch JD (2011) Dorsal striatal D2-like receptor availability covaries with sensitivity to positive reinforcement during discrimination learning. J Neurosci 31:7291–7299

    Article  PubMed  CAS  Google Scholar 

  • Haber SN (2003) The primate basal ganglia: parallel and integrative networks. J Chem Neuroanat 26:317–330

    Article  PubMed  Google Scholar 

  • Hornak J, O’Doherty J, Bramham J, Rolls ET, Morris RG, Bullock PR, Polkey CE (2004) Reward-related reversal learning after surgical excisions in orbito-frontal or dorsolateral prefrontal cortex in humans. J Cogn Neurosci 16:463–478

    Article  PubMed  CAS  Google Scholar 

  • Idris NF, Repeto P, Neill JC, Large CH (2005) Investigation of the effects of lamotrigine and clozapine in improving reversal-learning impairments induced by acute phencyclidine and D-amphetamine in the rat. Psychopharmacology (Berl) 179:336–348

    Article  CAS  Google Scholar 

  • Itami S, Uno H (2002) Orbitofrontal cortex dysfunction in attention-deficit hyperactivity disorder revealed by reversal and extinction tasks. Neuroreport 13:2453–2457

    Article  PubMed  Google Scholar 

  • Izquierdo A, Murray EA (2005) Opposing effects of amygdala and orbital prefrontal cortex lesions on the extinction of instrumental responding in macaque monkeys. Eur J Neurosci 22:2341–2346

    Article  PubMed  Google Scholar 

  • Izquierdo A, Murray EA (2007) Selective bilateral amygdala lesions in rhesus monkeys fail to disrupt object reversal learning. J Neurosci 27:1054–1062

    Article  PubMed  CAS  Google Scholar 

  • Izquierdo A, Suda RK, Murray EA (2004) Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J Neurosci 24:7540–7548

    Article  PubMed  CAS  Google Scholar 

  • Izquierdo A, Wiedholz LM, Millstein RA, Yang RJ, Bussey TJ, Saksida LM, Holmes A (2006) Genetic and dopaminergic modulation of reversal learning in a touchscreen-based operant procedure for mice. Behav Brain Res 171:181–188

    Article  PubMed  CAS  Google Scholar 

  • Izquierdo A, Newman TK, Higley JD, Murray EA (2007) Genetic modulation of cognitive flexibility and socioemotional behavior in rhesus monkeys. Proc Natl Acad Sci USA 104:14128–14133

    Article  PubMed  CAS  Google Scholar 

  • Izquierdo A, Belcher AM, Scott L, Cazares VA, Chen J, O’Dell SJ, Malvaez M, Wu T, Marshall JF (2010) Reversal-specific learning impairments after a binge regimen of methamphetamine in rats: possible involvement of striatal dopamine. Neuropsychopharmacology 35:505–514

    Article  PubMed  CAS  Google Scholar 

  • Jedema HP, Gianaros PJ, Greer PJ, Kerr DD, Liu S, Higley JD, Suomi SJ, Olsen AS, Porter JN, Lopresti BJ, Hariri AR, Bradberry CW (2010) Cognitive impact of genetic variation of the serotonin transporter in primates is associated with differences in brain morphology rather than serotonin neurotransmission. Mol Psychiatry 15(512–522):446

    Article  Google Scholar 

  • Jentsch JD, Taylor JR (2001) Impaired inhibition of conditioned responses produced by subchronic administration of phencyclidine to rats. Neuropsychopharmacology 24:66–74

    Article  PubMed  CAS  Google Scholar 

  • Jentsch JD, Redmond DE Jr, Elsworth JD, Taylor JR, Youngren KD, Roth RH (1997) Enduring cognitive deficits and cortical dopamine dysfunction in monkeys after long-term administration of phencyclidine. Science 277:953–955

    Article  PubMed  CAS  Google Scholar 

  • Jentsch JD, Olausson P, De La Garza R 2nd, Taylor JR (2002) Impairments of reversal learning and response perseveration after repeated, intermittent cocaine administrations to monkeys. Neuropsychopharmacology 26:183–190

    Article  PubMed  CAS  Google Scholar 

  • Jocham G, Klein TA, Neumann J, von Cramon DY, Reuter M, Ullsperger M (2009) Dopamine DRD2 polymorphism alters reversal learning and associated neural activity. J Neurosci 29:3695–3704

    Article  PubMed  CAS  Google Scholar 

  • Jones B, Mishkin M (1972) Limbic lesions and the problem of stimulus–reinforcement associations. Exp Neurol 36:362–377

    Article  PubMed  CAS  Google Scholar 

  • Kantak KM, Udo T, Ugalde F, Luzzo C, Di Pietro N, Eichenbaum HB (2005) Influence of cocaine self-administration on learning related to prefrontal cortex or hippocampus functioning in rats. Psychopharmacology (Berl) 181:227–236

    Article  CAS  Google Scholar 

  • Kosheleff AR, Grimes M, O’Dell SJ, Marshall JF, Izquierdo A (2011) Work aversion and associated changes in dopamine and serotonin transporter after methamphetamine exposure in rats. Psychopharmacology (Berl). doi:10.1007/s00213-011-2367-4

  • Kruzich PJ, Grandy DK (2004) Dopamine D2 receptors mediate two-odor discrimination and reversal learning in C57BL/6 mice. BMC Neurosci 5:12

    Article  PubMed  Google Scholar 

  • Kruzich PJ, Mitchell SH, Younkin A, Grandy DK (2006) Dopamine D2 receptors mediate reversal learning in male C57BL/6J mice. Cogn Affect Behav Neurosci 6:86–90

    Article  PubMed  Google Scholar 

  • Kulig BM, Calhoun WH (1972) Enhancement of successive discrimination reversal learning by methamphetamine. Psychopharmacologia 27:233–240

    Article  PubMed  CAS  Google Scholar 

  • Lapiz MD, Morilak DA (2006) Noradrenergic modulation of cognitive function in rat medial prefrontal cortex as measured by attentional set shifting capability. Neuroscience 137:1039–1049

    Article  PubMed  CAS  Google Scholar 

  • Lapiz MD, Bondi CO, Morilak DA (2007) Chronic treatment with desipramine improves cognitive performance of rats in an attentional set-shifting test. Neuropsychopharmacology 32:1000–1010

    Article  PubMed  CAS  Google Scholar 

  • Lapiz-Bluhm MD, Soto-Pina AE, Hensler JG, Morilak DA (2009) Chronic intermittent cold stress and serotonin depletion induce deficits of reversal learning in an attentional set-shifting test in rats. Psychopharmacology (Berl) 202:329–341

    Article  CAS  Google Scholar 

  • Laughlin RE, Grant TL, Williams RW, Jentsch JD (2011) Genetic dissection of behavioral flexibility: reversal learning in mice. Biol Psychiatry 69:1109–1116

    Article  PubMed  CAS  Google Scholar 

  • Lee B, Groman S, London ED, Jentsch JD (2007) Dopamine D2/D3 receptors play a specific role in the reversal of a learned visual discrimination in monkeys. Neuropsychopharmacology 32:2125–2134

    Article  PubMed  CAS  Google Scholar 

  • Lee B, London ED, Poldrack RA, Farahi J, Nacca A, Monterosso JR, Mumford JA, Bokarius AV, Dahlbom M, Mukherjee J, Bilder RM, Brody AL, Mandelkern MA (2009) Striatal dopamine d2/d3 receptor availability is reduced in methamphetamine dependence and is linked to impulsivity. J Neurosci 29:14734–14740

    Article  PubMed  CAS  Google Scholar 

  • Man MS, Clarke HF, Roberts AC (2008) The role of the orbitofrontal cortex and medial striatum in the regulation of prepotent responses to food rewards. Cereb Cortex

  • Masaki D, Yokoyama C, Kinoshita S, Tsuchida H, Nakatomi Y, Yoshimoto K, Fukui K (2006) Relationship between limbic and cortical 5-HT neurotransmission and acquisition and reversal learning in a go/no-go task in rats. Psychopharmacology (Berl) 189:249–258

    Article  CAS  Google Scholar 

  • McAlonan K, Brown VJ (2003) Orbital prefrontal cortex mediates reversal learning and not attentional set shifting in the rat. Behav Brain Res 146:97–103

    Article  PubMed  Google Scholar 

  • McLean SL, Neill JC, Idris NF, Marston HM, Wong EH, Shahid M (2010) Effects of asenapine, olanzapine, and risperidone on psychotomimetic-induced reversal-learning deficits in the rat. Behav Brain Res 214:240–247

    Article  PubMed  CAS  Google Scholar 

  • Mehta MA, Swainson R, Ogilvie AD, Sahakian J, Robbins TW (2001) Improved short-term spatial memory but impaired reversal learning following the dopamine D(2) agonist bromocriptine in human volunteers. Psychopharmacology (Berl) 159:10–20

    Article  CAS  Google Scholar 

  • Millan MJ, Lejeune F, Gobert A, Brocco M, Auclair A, Bosc C, Rivet JM, Lacoste JM, Cordi A, Dekeyne A (2000) S18616, a highly potent spiroimidazoline agonist at alpha(2)-adrenoceptors: II. Influence on monoaminergic transmission, motor function, and anxiety in comparison with dexmedetomidine and clonidine. J Pharmacol Exp Ther 295:1206–1222

    PubMed  CAS  Google Scholar 

  • Morellini F, Sivukhina E, Stoenica L, Oulianova E, Bukalo O, Jakovcevski I, Dityatev A, Irintchev A, Schachner M (2010) Improved reversal learning and working memory and enhanced reactivity to novelty in mice with enhanced GABAergic innervation in the dentate gyrus. Cereb Cortex 20:2712–2727

    Article  PubMed  Google Scholar 

  • Murphy FC, Smith KA, Cowen PJ, Robbins TW, Sahakian BJ (2002) The effects of tryptophan depletion on cognitive and affective processing in healthy volunteers. Psychopharmacology (Berl) 163:42–53

    Article  CAS  Google Scholar 

  • Murray EA, Gaffan D (2006) Prospective memory in the formation of learning sets by rhesus monkeys (Macaca mulatta). J Exp Psychol Anim Behav Process 32:87–90

    Article  PubMed  Google Scholar 

  • Murray EA, Richmond BJ (2001) Role of perirhinal cortex in object perception, memory, and associations. Curr Opin Neurobiol 11:188–193

    Article  PubMed  CAS  Google Scholar 

  • Murray EA, Baxter MG, Gaffan D (1998) Monkeys with rhinal cortex damage or neurotoxic hippocampal lesions are impaired on spatial scene learning and object reversals. Behav Neurosci 112:1291–1303

    Article  PubMed  CAS  Google Scholar 

  • Nonkes LJ, Maes JH, Homberg J (2011) Improved cognitive flexibility in serotonin transporter knockout rats is unchanged following chronic cocaine self-administration. Addict Biol. doi:10.1111/j.1369-1600.2011.00351.x

  • O’Doherty J, Kringelbach ML, Rolls ET, Hornak J, Andrews C (2001) Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci 4:95–102

    Article  PubMed  Google Scholar 

  • Perkins KA, Lerman C, Coddington SB, Jetton C, Karelitz JL, Scott JA, Wilson AS (2008) Initial nicotine sensitivity in humans as a function of impulsivity. Psychopharmacology (Berl) 200:529–544

    Article  CAS  Google Scholar 

  • Perry JL, Carroll ME (2008) The role of impulsive behavior in drug abuse. Psychopharmacology (Berl) 200:1–26

    Article  CAS  Google Scholar 

  • Ragozzino ME, Adams S, Kesner RP (1998) Differential involvement of the dorsal anterior cingulate and prelimbic–infralimbic areas of the rodent prefrontal cortex in spatial working memory. Behav Neurosci 112:293–303

    Article  PubMed  CAS  Google Scholar 

  • Ragozzino ME, Detrick S, Kesner RP (1999a) Involvement of the prelimbic–infralimbic areas of the rodent prefrontal cortex in behavioral flexibility for place and response learning. J Neurosci 19:4585–4594

    PubMed  CAS  Google Scholar 

  • Ragozzino ME, Wilcox C, Raso M, Kesner RP (1999b) Involvement of rodent prefrontal cortex subregions in strategy switching. Behav Neurosci 113:32–41

    Article  PubMed  CAS  Google Scholar 

  • Remijnse PL, Nielen MM, van Balkom AJ, Cath DC, van Oppen P, Uylings HB, Veltman DJ (2006) Reduced orbitofrontal–striatal activity on a reversal learning task in obsessive-compulsive disorder. Arch Gen Psychiatry 63:1225–1236

    Article  PubMed  Google Scholar 

  • Rich EL, Shapiro M (2009) Rat prefrontal cortical neurons selectively code strategy switches. J Neurosci 29:7208–7219

    Article  PubMed  CAS  Google Scholar 

  • Ridley RM, Baker HF, Haystead TA (1981a) Perseverative behaviour after amphetamine; dissociation of response tendency from reward association. Psychopharmacology (Berl) 75:283–286

    Article  CAS  Google Scholar 

  • Ridley RM, Haystead TA, Baker HF (1981b) An analysis of visual object reversal learning in the marmoset after amphetamine and haloperidol. Pharmacol Biochem Behav 14:345–351

    Article  PubMed  CAS  Google Scholar 

  • Robbins TW (2005) Chemistry of the mind: neurochemical modulation of prefrontal cortical function. J Comp Neurol 493:140–146

    Article  PubMed  CAS  Google Scholar 

  • Robbins TW, James M, Owen AM, Sahakian BJ, Lawrence AD, McInnes L, Rabbitt PM (1998) A study of performance on tests from the CANTAB battery sensitive to frontal lobe dysfunction in a large sample of normal volunteers: implications for theories of executive functioning and cognitive aging. Cambridge Neuropsychological Test Automated Battery. J Int Neuropsychol Soc 4:474–490

    Article  PubMed  CAS  Google Scholar 

  • Roberts AC, Wallis JD (2000) Inhibitory control and affective processing in the prefrontal cortex: neuropsychological studies in the common marmoset. Cereb Cortex 10:252–262

    Article  PubMed  CAS  Google Scholar 

  • Romer D, Betancourt L, Giannetta JM, Brodsky NL, Farah M, Hurt H (2009) Executive cognitive functions and impulsivity as correlates of risk taking and problem behavior in preadolescents. Neuropsychologia 47:2916–2926

    Article  PubMed  Google Scholar 

  • Rudebeck PH, Murray EA (2008) Amygdala and orbitofrontal cortex lesions differentially influence choices during object reversal learning. J Neurosci 28:8338–8343

    Article  PubMed  CAS  Google Scholar 

  • Rudebeck PH, Murray EA (2011) Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on reward-guided behavior. J Neurosci 31:10569–10578

    Article  PubMed  CAS  Google Scholar 

  • Rudebeck PH, Behrens TE, Kennerley SW, Baxter MG, Buckley MJ, Walton ME, Rushworth MF (2008) Frontal cortex subregions play distinct roles in choices between actions and stimuli. J Neurosci 28:13775–13785

    Article  PubMed  CAS  Google Scholar 

  • Schoenbaum G, Setlow B (2005) Cocaine makes actions insensitive to outcomes but not extinction: implications for altered orbitofrontal–amygdalar function. Cereb Cortex 15:1162–1169

    Article  PubMed  Google Scholar 

  • Schoenbaum G, Shaham Y (2008) The role of orbitofrontal cortex in drug addiction: a review of preclinical studies. Biol Psychiatry 63:256–262

    Article  PubMed  CAS  Google Scholar 

  • Schoenbaum G, Setlow B, Nugent SL, Saddoris MP, Gallagher M (2003) Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learn Mem 10:129–140

    Article  PubMed  Google Scholar 

  • Schoenbaum G, Saddoris MP, Ramus SJ, Shaham Y, Setlow B (2004) Cocaine-experienced rats exhibit learning deficits in a task sensitive to orbitofrontal cortex lesions. Eur J Neurosci 19:1997–2002

    Article  PubMed  Google Scholar 

  • Seu E, Jentsch JD (2009) Effect of acute and repeated treatment with desipramine or methylphenidate on serial reversal learning in rats. Neuropharmacology 57:665–672

    Article  PubMed  CAS  Google Scholar 

  • Seu E, Lang A, Rivera RJ, Jentsch JD (2009) Inhibition of the norepinephrine transporter improves behavioral flexibility in rats and monkeys. Psychopharmacology (Berl) 202:505–519

    Article  CAS  Google Scholar 

  • Shoblock JR, Maisonneuve IM, Glick SD (2003) Differences between d-methamphetamine and d-amphetamine in rats: working memory, tolerance, and extinction. Psychopharmacology (Berl) 170:150–156

    Article  CAS  Google Scholar 

  • Smith AG, Neill JC, Costall B (1999) The dopamine D3/D2 receptor agonist 7-OH-DPAT induces cognitive impairment in the marmoset. Pharmacol Biochem Behav 63:201–211

    Article  PubMed  CAS  Google Scholar 

  • Stalnaker TA, Franz TM, Singh T, Schoenbaum G (2007) Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments. Neuron 54:51–58

    Article  PubMed  CAS  Google Scholar 

  • Takahashi Y, Roesch MR, Stalnaker TA, Schoenbaum G (2007) Cocaine exposure shifts the balance of associative encoding from ventral to dorsolateral striatum. Front Integr Neurosci 1

  • Vallender EJ, Lynch L, Novak MA, Miller GM (2009) Polymorphisms in the 3′ UTR of the serotonin transporter are associated with cognitive flexibility in rhesus macaques. Am J Med Genet B Neuropsychiatr Genet 150B:467–475

    Article  PubMed  CAS  Google Scholar 

  • van der Plasse G, Feenstra MG (2008) Serial reversal learning and acute tryptophan depletion. Behav Brain Res 186:23–31

    Article  PubMed  CAS  Google Scholar 

  • Verdejo-Garcia A, Lawrence AJ, Clark L (2008) Impulsivity as a vulnerability marker for substance-use disorders: review of findings from high-risk research, problem gamblers and genetic association studies. Neurosci Biobehav Rev 32:777–810

    Article  PubMed  Google Scholar 

  • Volkow ND, Chang L, Wang GJ, Fowler JS, Ding YS, Sedler M, Logan J, Franceschi D, Gatley J, Hitzemann R, Gifford A, Wong C, Pappas N (2001) Low level of brain dopamine D2 receptors in methamphetamine abusers: association with metabolism in the orbitofrontal cortex. Am J Psychiatry 158:2015–2021

    Article  PubMed  CAS  Google Scholar 

  • Volkow ND, Wang GJ, Telang F, Fowler JS, Logan J, Childress AR, Jayne M, Ma Y, Wong C (2006) Cocaine cues and dopamine in dorsal striatum: mechanism of craving in cocaine addiction. J Neurosci 26:6583–6588

    Article  PubMed  CAS  Google Scholar 

  • Weiner I, Feldon J (1986) Reversal and nonreversal shifts under amphetamine. Psychopharmacology (Berl) 89:355–359

    Article  CAS  Google Scholar 

  • White IM, Minamoto T, Odell JR, Mayhorn J, White W (2009) Brief exposure to methamphetamine (METH) and phencyclidine (PCP) during late development leads to long-term learning deficits in rats. Brain Res 1266:72–86

    Article  PubMed  CAS  Google Scholar 

  • Wilpizeski CR, Hamilton CL (1964) Drug-induced decrement in spatial reversal learning in the white rat. Psychopharmacologia 6:475–479

    Article  PubMed  CAS  Google Scholar 

  • Winocur G, Eskes G (1998) Prefrontal cortex and caudate nucleus in conditional associative learning: dissociated effects of selective brain lesions in rats. Behav Neurosci 112:89–101

    Article  PubMed  CAS  Google Scholar 

  • Winocur G, Mills JA (1969) Effects of caudate lesions on avoidance behavior in rats. J Comp Physiol Psychol 68:552–557

    Article  PubMed  CAS  Google Scholar 

  • Winstanley CA, Olausson P, Taylor JR, Jentsch JD (2010) Insight into the relationship between impulsivity and substance abuse from studies using animal models. Alcohol Clin Exp Res 34:1306–1318

    PubMed  Google Scholar 

  • Zald DH, Cowan RL, Riccardi P, Baldwin RM, Ansari MS, Li R, Shelby ES, Smith CE, McHugo M, Kessler RM (2008) Midbrain dopamine receptor availability is inversely associated with novelty-seeking traits in humans. J Neurosci 28:14372–14378

    Article  PubMed  CAS  Google Scholar 

Download references

Acknowledgements

This work was supported by Public Health Service grants 1SC2MH087974 (Izquierdo), the NIH MBRS program at CSULA (grant R25 GM61331) and by the Consortium for Neuropsychiatric Phenomics at UCLA (UL1-DE019580 and RL1-MH083270). Additional support was derived from PHS grants P20-DA022539 and P50-MH077248 (Jentsch).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alicia Izquierdo.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Izquierdo, A., Jentsch, J.D. Reversal learning as a measure of impulsive and compulsive behavior in addictions. Psychopharmacology 219, 607–620 (2012). https://doi.org/10.1007/s00213-011-2579-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00213-011-2579-7

Keywords

Navigation