Review
Extinction of drug seeking

https://doi.org/10.1016/j.bbr.2010.10.037Get rights and content

Abstract

Drug seeking behavior can be reduced or inhibited via extinction. The brain mechanisms for extinction of drug seeking are poorly understood but are of significant interest because of their potential to identify novel approaches that promote abstinence from drug taking. Here we review recent literature on the neural mechanisms for extinction in drug self-administration paradigms. First, we consider the brain regions important for extinction of drug seeking. Functional inactivation studies have identified infralimbic prefrontal cortex, nucleus accumbens shell, as well as medial dorsal hypothalamus in the expression of extinction of drug seeking. These structures have been implicated in extinction expression across several reinforcers including cocaine, heroin, and alcohol. Second, we consider molecular studies which show that extinction training is associated with plasticity in glutamatergic signaling in both nucleus accumbens shell and core, and that this training may reverse or ameliorate the neuroadaptations produced by chronic drug exposure and spontaneous withdrawal. Finally, we consider the neural circuitry for extinction of drug seeking. Functional disconnection and neuroanatomical tracing studies show that extinction expression depends, at least in part, on cortico-striatal–hypothalamic and cortico-hypothalalmic–thalamic pathways. Moreover, they indicate that the expression of extinction and reinstatement of drug seeking may depend on parallel pathways that converge within lateral hypothalamus and paraventricular thalamus.

Research highlights

▶The expression of extinction of drug seeking is dependent upon IL, AcbSh, and MDH. ▶ Extinction training induces plasticity in glutamatergic signaling in AcbSh and AcbC. ▶ The actions of glutamate, GABA, and dynorphin in these pathways are critical. ▶ The expression of extinction of drug seeking depends on parallel pathways. ▶ The neural circuits of extinction expression overlap with those for reinstatement.

Introduction

Drug addiction is a chronic relapsing condition imposing significant burdens on individual addicts, their families, and communities. Addiction is associated with increased rates of physical health problems including cardiovascular and liver disease; mental health problems including depression and anxiety; reduced levels of productivity, as well as higher utilization of health and social services. Considerable progress has been made in understanding the mechanisms of drug addiction including those contributing to the reinforcing effects of drugs of abuse; the escalation and loss of control over drug intake rendering it compulsive; and, those determining relapse to drug seeking and taking after periods of abstinence. Yet many aspects remain poorly understood. Among these are the mechanisms for extinction of drug seeking.

Extinction is the reduction in drug seeking when the contingency between drug seeking behavior or drug predictive stimuli and the delivery of the drug reward is broken. Extinction is an active learning process. It recruits as yet poorly understood neural circuits to reduce drug seeking. There is evidence that extinction can ameliorate or reverse the neuroadaptations produced by chronic drug self-administration and/or by spontaneous abstinence from drug seeking. Nonetheless, extinction does not erase drug seeking. Rather, it actively inhibits it. This inhibition can be removed in several ways, including via re-presentations of the reinforcer (reinstatement [1]), presentations of a drug-associated stimulus (cue-induced reinstatement) [1], or context-change between extinction and test (context-induced reinstatement) [2]. These restoration or reinstatement phenomena emphasize that at the end of extinction training animals hold conflicting associations: an association from original self-administration training promoting reinstatement of drug seeking and an association from extinction training that opposes or inhibits drug seeking. Despite increasing knowledge regarding neural mechanisms for reinstatement of drug seeking (e.g. [3], [4]), much less is known about the neural mechanisms for extinction of drug self-administration and how extinction inhibits drug seeking. Understanding the mechanisms for extinction of drug self-administration is important because it may help identify, develop, and direct new approaches to promoting abstinence from drug taking and preventing relapse.

Here we review the recent literature on the neural mechanisms for extinction of drug seeking. We focus on findings from self-administration paradigms. The reader is referred to Myers and Carlezon [5] for review of findings from studies using the conditioned place preference procedure. Myers and Davis [6] noted that ‘extinction’ can refer to multiple processes. We follow these authors and use the term ‘extinction’ in reference to the processes underlying loss of responding in drug self-administration paradigms. Likewise, we define the methodological procedure that promotes these losses as ‘extinction training’ and the decrement in responding observed after extinction training as ‘extinction expression’.

Studies of the neural mechanisms of extinction involve a three stage procedure. In initial training, animals are trained to respond (lever press or nose poke) for a drug reward. During extinction training this responding is no longer reinforced. Finally, rats are tested, again under non-reinforcement, for drug seeking. Experimental manipulations or measurements of neural function typically occur at one of three different times during this procedure. Extinction expression studies involve manipulations or measurements prior to test. Extinction learning studies involve manipulations or measurements prior to extinction training. Finally, studies examining consolidation of extinction learning involve manipulations or measurements in the period immediately following extinction training. It is important to note, that in contrast to other preparations for the study of extinction such as fear conditioning, drug self-administration preparations typically involve multiple days of extinction training in relatively long (up to 2 h) sessions. This renders empirical dissociation between extinction learning and extinction expression more difficult because each day of extinction training involves the influences of both extinction learning (from that session) and extinction expression (from previous extinction sessions as well as that session).

Section snippets

Prefrontal cortex

The prefrontal cortex (PFC) has long been implicated in reinstatement of drug seeking (for review see [4], [7]). These studies have emphasized the specific role for the prelimbic (PL) region in reinstatement of drug seeking. For example, reversible inactivation of PL prevents cocaine priming [62] and stress [8], [9] induced reinstatement of cocaine seeking. Moreover a similar prevention of cocaine priming reinstatement of cocaine seeking is observed after microinjections of D1-like or D2-like

Nucleus accumbens

A variety of lines of evidence implicatenucleus accumbens (Acb) in extinction of drug self-administration. Here we briefly review the relevant neuroanatomical properties of Acb followed by evidence from molecular, electrophysiological, and reversible inactivation studies that Acb contributes to extinction of drug self-administration.

Acb is the ventral extension of the striatum. It receives direct glutamatergic inputs from limbic sites including hippocampus, medial prefrontal cortex, entorhinal

Medial dorsal hypothalamus

Hypothalamus has long been implicated in regulating primary reward and feeding [98], [99] and, more recently, responding to drug associated stimuli [35], [36]. Moreover, the neuropeptide orexin, which is expressed solely in hypothalamic neurons, plays an important role in reinstatement of drug seeking. Stimulation of orexin receptors can reinstate conditioned place preference [35] whereas the orexin antagonist SB 334867 prevents cue or yohimbine induced reinstatement of extinguished alcohol

Neural circuit level mechanisms for extinction of drug seeking

As reviewed above, IL, AcbSh, and MDH have each been implicated in expression of extinction of drug seeking from studies using intravenous cocaine or alcoholic beer reinforcers. There are at least two important questions regarding neural circuit level mechanisms for extinction expression. The first is the nature of the connectivity between these regions. The second is how these structures interface with the circuits mediating reinstatement. There are strong theoretical and empirical reasons for

Conclusions

Extinction produces a significant reduction in drug seeking. The literature reviewed here shows that this reduction in drug seeking is dependent upon cortical, striatal, and hypothalamic regions that include IL, AcbSh, and MDH. Studies of the connectivity and functional interaction between these regions suggest that the expression of extinction of drug seeking depends, in part, on cortico-striatal–hypothalamic and cortico-hypothalalmic–thalamic pathways. Within these pathways the actions of the

Acknowledgements

Preparation of this manuscript was supported by Australian Postgraduate Awards to EZM and NJM as well as grants (510199 and 630406) from the National Health and Medical Research Council to GPM. GPM is an Australian Research Council QEII Fellow (DP0877430).

References (105)

  • J.K. Elmquist et al.

    From lesions to leptin: hypothalamic control of food intake and body weight

    Neuron

    (1999)
  • J. Chen et al.

    Characterization of the feeding inhibition and neural activation produced by dorsomedial hypothalamic cholecystokinin administration

    Neuroscience

    (2008)
  • Z. Pirnik et al.

    Effect of anorexinergic peptides, cholecystokinin (CCK) and cocaine and amphetamine regulated transcript (CART) peptide, on the activity of neurons in hypothalamic structures of C57Bl/6 mice involved in the food intake regulation

    Peptides

    (2010)
  • H.C. Cromwell et al.

    Where does damage lead to enhanced food aversion: the ventral pallidum/substantia innominata or lateral hypothalamus?

    Brain Res

    (1993)
  • M.J. Christie et al.

    Excitatory amino acid projections to the nucleus accumbens septi in the rat: a retrograde transport study utilizing D[3H]aspartate and [3H]GABA

    Neuroscience

    (1987)
  • P.K. Thanos et al.

    D-cycloserine accelerates the extinction of cocaine-induced conditioned place preference in C57bL/c mice

    Behav Brain Res

    (2009)
  • E.J. Santa Ana et al.

    d-Cycloserine attenuates reactivity to smoking cues in nicotine dependent smokers: a pilot investigation

    Drug Alcohol Depend

    (2009)
  • M.E. Bouton

    Context, ambiguity, and unlearning: sources of relapse after behavioral extinction

    Biol Psychiatry

    (2002)
  • G.J. Mogenson et al.

    From motivation to action: Functional interface between the limbic system and the motor system

    Prog Neurobiol

    (1980)
  • L. Záborszky et al.

    Cholecystokinin innervation of the ventral striatum: A morphological and radioimmunological study

    Neuroscience

    (1985)
  • S.B. Floresco et al.

    Opposing roles for the nucleus accumbens core and shell in cue-induced reinstatement of food-seeking behavior

    Neuroscience

    (2008)
  • S. Ikemoto

    Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex

    Brain Res Rev

    (2007)
  • P.H. Janak et al.

    Dynamics of neural coding in the accumbens during extinction and reinstatement of rewarded behavior

    Behav Brain Res

    (2004)
  • A.E. Kelley et al.

    Corticostriatal-hypothalamic circuitry and food motivation: Integration of energy, action and reward

    Physiol Behav

    (2005)
  • L.J. Porrino et al.

    Two types of medial hypothalamic inhibition of lateral hypothalamic reward

    Brain Res

    (1983)
  • H. de Wit et al.

    Reinstatement of cocaine-reinforced responding in the rat

    Psychopharmacology

    (1981)
  • H.S. Crombag et al.

    Renewal of drug seeking by contextual cues after prolonged extinction in rats

    Behav Neurosci

    (2002)
  • H.S. Crombag et al.

    Context-induced relapse to drug seeking: a review

    Philos Trans R Soc Lond B Biol Sci

    (2008)
  • P.W. Kalivas et al.

    The neural basis of addiction: a pathology of motivation and choice

    Am J Psychiatry

    (2000)
  • K.M. Myers et al.

    Extinction of drug- and withdrawal-paired cues in animal models: relevance to the treatment of addiction

    Neurosci Biobehav Rev

    (2010)
  • G.V. Rebec et al.

    Neuronal substrates of relapse to cocaine seekingbehavior: role of prefrontal cortex

    J Exp Anal Behav

    (2005)
  • N. Capriles et al.

    A role for the prefrontal cortex in stress- and cocaine-induced reinstatement of cocaine seeking in rats

    Psychopharmacology

    (2003)
  • K. McFarland et al.

    Limbic and motor circuitry underlying footshock-induced reinstatement of cocaine seeking behavior

    J Neurosci

    (2004)
  • W. Sun et al.

    The role of prefrontal cortex D1-like and D2-like receptors in cocaine seeking behavior in rats

    Psychopharmacology

    (2005)
  • V. Laurent et al.

    Inactivation of the infralimbic but not the prelimbic cortex impairs consolidation and retrieval of fear extinction

    Learn Mem

    (2009)
  • K. Lebrón et al.

    Delayed recall of fear extinction in rats with lesions of ventral medial prefrontal cortex

    Learn Mem

    (2004)
  • D. Sierra-Mercado et al.

    Inactivation of the ventromedial prefrontal cortex reduces expression of conditioned fear and impairs subsequent recall of extinction

    Eur J Neurosci

    (2006)
  • G.J. Quirk et al.

    The role of ventromedial prefrontal cortex in the recovery of extinguished fear

    J Neurosci

    (2000)
  • S. Hugues et al.

    Postextinction infusion of a mitogen-activated protein kinase inhibitor into the medial prefrontal cortex impairs memory of the extinction of conditioned fear

    Learn Mem

    (2004)
  • S. Hugues et al.

    Prefrontal infusion of PD098059 immediately after fear extinction training blocks extinction-associated prefrontal synaptic plasticity and decreases prefrontal ERK2 phosphorylation

    Synapse

    (2006)
  • E. Santini et al.

    Consolidation of fear extinction requires protein synthesis in the medial prefrontal cortex

    J Neurosci

    (2004)
  • E. Knapska et al.

    Reciprocal patterns of c-Fos expression in the medial prefrontal cortex and amygdala after extinction and renewal of conditioned fear

    Learn Mem

    (2009)
  • M.R. Milad et al.

    Neurons in medial prefrontal cortex signal memory for fear extinction

    Nature

    (2002)
  • E. Santini et al.

    Fear conditioning and extinction differentially modify the intrinsic excitability of infralimbic neurons

    J Neurosci

    (2008)
  • M.R. Milad et al.

    Electrical stimulation of medial prefrontal cortex reduces conditioned fear in a temporally specific manner

    Behav Neurosci

    (2004)
  • J. Peters et al.

    Infralimbic prefrontal cortex is responsible for inhibiting cocaine seeking in extinguished rats

    J Neurosci

    (2008)
  • N.J. Marchant et al.

    Medial dorsal hypothalamus mediates the inhibition of reward seeking after extinction

    J Neurosci

    (2010)
  • R.T. LaLumiere et al.

    The infralimbic cortex regulates the consolidation of extinction after cocaine self-administration

    Learn Mem

    (2010)
  • J. Peters et al.

    Extinction circuits for fear and addiction overlap in prefrontal cortex

    Learn Mem

    (2009)
  • P. O’Donnell et al.

    Interconnected parallel circuits between rat nucleus accumbens and thalamus revealed by retrograde transynaptic transport of pseudorabies virus

    J Neurosci

    (1997)
  • Cited by (103)

    View all citing articles on Scopus
    View full text