Locus Coeruleus Norepinephrine in Learned Behavior: Anatomical Modularity and Spatiotemporal Integration in Targets
Vincent Breton-Provencher
Gabrielle T. Drummond
Mriganka Sur- Picower Institute for Learning and Memory, Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, United States
The locus coeruleus (LC), a small brainstem nucleus, is the primary source of the neuromodulator norepinephrine (NE) in the brain. The LC receives input from widespread brain regions, and projects throughout the forebrain, brainstem, cerebellum, and spinal cord. LC neurons release NE to control arousal, but also in the context of a variety of sensory-motor and behavioral functions. Despite its brain-wide effects, much about the role of LC-NE in behavior and the circuits controlling LC activity is unknown. New evidence suggests that the modular input-output organization of the LC could enable transient, task-specific modulation of distinct brain regions. Future work must further assess whether this spatial modularity coincides with functional differences in LC-NE subpopulations acting at specific times, and how such spatiotemporal specificity might influence learned behaviors. Here, we summarize the state of the field and present new ideas on the role of LC-NE in learned behaviors.
Introduction
Norepinephrine (NE) is one of the four main neuromodulators in the brain, exerting widespread influence over almost all cortical and subcortical brain regions. Neurons in the locus coeruleus (LC) release NE to regulate baseline arousal and to facilitate a variety of sensory-motor and behavioral functions (Aston-Jones and Cohen, 2005; Sara, 2009; Sara and Bouret, 2012; Poe et al., 2020). Dysfunction in the LC-NE system has been implicated in the etiology of ADHD (Arnsten, 2011), schizophrenia (Friedman et al., 1999), anxiety or stress (Valentino and Van Bockstaele, 2008; Arnsten et al., 2015; Reyes et al., 2015), and depression (Delgado and Moreno, 2000), as well as in the cognitive decline observed in aging and Alzheimer’s disease (Weinshenker, 2008).
Despite its brain-wide effects and established involvement in CNS disorders, much about even the normal function of the LC-NE system in the brain remains unknown. For example, the conditions under which LC-NE neurons are transiently activated and the modes of NE action during learned behaviors are poorly understood, especially in comparison to other neuromodulatory systems, such as dopamine (Schultz et al., 1997; Schultz, 1998, 2016; Engelhard et al., 2019). There are at least three reasons for this gap. First, the activation of phasic NE has been traditionally examined in the context of sensory, motor, or goal-oriented events with little consideration of its role in signaling temporal stimulus-action-reward sequences or task parameters such as uncertainty. Second, the functions of phasic NE have been interpreted in the context of global or brain-wide influences, without considering selective spatial targeting. Third, the LC is a small nucleus, with a small number of neurons projecting throughout the brain, thus exhibiting relatively low innervation density as compared to other neuromodulatory systems, which typically have a larger number of neurons with a distinct projection network (e.g., substantia nigra and ventral tegmental area for dopamine). For this reason, methods for recording and manipulating LC-NE activity during behavior have been technically challenging. Recent studies have begun to overcome many of these challenges, enabling a more thorough understanding of the role of LC-NE in different aspects of cognition and behavior. Here, we review the current state of the field and present new ideas on the organization, activation, and function of LC-NE neurons.
Anatomy of the Ne System
Despite its small number of neurons [∼3,000 neurons in the rodent brain (Sara, 2009) and ∼50,000 in the human brain (Sharma et al., 2010)], the LC serves as the primary source of NE in the forebrain with a highly divergent set of projections. Indeed, most cortical and subcortical areas receive dense LC-NE axonal innervation with the marked exception of the striatum (Pickel et al., 1974; Jones and Moore, 1977; Nomura et al., 2014), which receives limited innervations from the LC (Zerbi et al., 2019; Figure 1A). LC is reported to receive inputs from up to 111 distinct brain regions, including most brain-stem and forebrain regions (Schwarz et al., 2015; Breton-Provencher and Sur, 2019; Figure 1B). Brainstem inputs, most notably from the gigantocellular reticular nucleus (Jones and Yang, 1985) – which responds to tactile, visual, vestibular, and olfactory stimuli (Tabansky et al., 2018) – result in LC activation following salient sensory stimuli. Meanwhile, top-down inputs from the prefrontal cortex (PFC) and central amygdala can modulate the intensity of LC activation (Sara and Hervé-Minvielle, 1995; Jodo et al., 1998; McCall et al., 2015). These convergent inputs suggest its recruitment in both bottom-up, sensory induced, as well as top-down, goal-directed, regulation of behavior. This input-output organization leaves the LC poised to modulate brain function in response to external stimuli and internal states, and modify it through learning. Determining the contexts that trigger LC activity and how, in turn, this activity affects brain circuits is critical to understanding the role of LC-NE in cognition.
Figure 1. Anatomy of the LC-NE system. (A) Anatomy of the outputs originating from the LC nucleus in human and mouse. Shaded areas indicate major sub-regions that potentially send input to LC. In this illustration, we have assumed that input regions identified in mouse are similar in humans (B) Distal inputs to LC-NE neurons obtained by retrograde tracing using rabies virus targeted at LC-NE neurons in mice. Input regions are grouped by: cortex (CTX), striatum (STR), pallidum (PAL), hypothalamus (HY), amygdala (AMY), midbrain (MB), medulla (MY), and cerebellum (CB). The thickness of each line represents the strength of the input from each region. Input strength was calculated by counting the number of cells retrogradely labeled in a specific area and dividing it by the total number of retrogradely labeled neurons. Regions providing less than 0.5% of inputs were left out of this diagram. Local inputs from the pons were also excluded. PFC, prefrontal cortex; MO, motor area; SS, somatosensory area; Acb, nucleus accumbens; CP, caudoputamen; BST, bed nucleus of stria terminalis; MS/NDB, medial septal/diagonal band nucleus; MPO, medial preoptic area; DMH/PVH, dorsomedial/paraventricular nucleus; LHA, lateral hypothalamic area; ZI, zona incerta; PSTN, parasubthalamic nucleus; CEA, central amygdala; SNc, substantia nigra; MRN, midbrain reticular nucleus; IPN, interpeduncular nucleus; PAG, periaqueductal gray; SC, superior colliculus; IC, inferior colliculus; PRP, nucleus prepositus; IRN, intermediate reticular nucleus; GRN, gigantocellular reticular nucleus; SPV, spinal nucleus of the trigeminal; CBX, cerebellar cortex; and CBN, cerebellar nuclei. Data in (B) from Breton-Provencher and Sur (2019).
Local LC Circuits
Norepinephrine neuronal bodies make up a dense LC “core,” with LC-NE dendrites extending into a pericoeruleus “shell” region. The pericoerulear region also contains GABAergic (LC-GABA), glutamatergic, neuropeptide-S-expressing, and cholinergic neurons (Xu et al., 2004; Boucetta et al., 2014; Cox et al., 2016). Whether all these neuronal subtypes make direct connections with LC-NE neurons, as well as their function in LC modulated behaviors, remains unresolved. Nonetheless, the neuronal subtype that has received the most attention is the LC-GABA population, which forms inhibitory synapses on LC-NE neurons (Aston-Jones et al., 2004; Jin et al., 2016; Breton-Provencher and Sur, 2019; Kuo et al., 2020; Figure 2A). Tracing experiments indicate that these LC-GABA neurons receive inputs from largely the same brain regions as LC-NE neurons, with only several regions exhibiting preferential projections to either LC-GABA or LC-NE neurons (Breton-Provencher and Sur, 2019; Figures 2B,C). Direct recordings from LC-GABA neurons show that they are highly active during wakefulness (Cox et al., 2016; Breton-Provencher and Sur, 2019). A subpopulation of LC-GABA neurons are active simultaneously with LC-NE neurons, reflecting coincident inputs to both LC-NE and LC-GABA populations (Breton-Provencher and Sur, 2019). Coincident inputs to LC-NE and LC-GABA neurons play a critical role in controlling the phasic activity of LC-NE neurons (Kuo et al., 2020) and resultant transient increases in arousal in response to salient sensory stimuli (Breton-Provencher and Sur, 2019). Based on retrograde labeling, LC-GABA neurons would receive preferential, or non-coincident, inputs from several brain regions, suggesting that these regions can exert inhibitory control of LC-NE activity (Breton-Provencher and Sur, 2019; Figure 2C). Further studies using input mapping with electrophysiology are required to confirm the existence of preferential inputs to LC-GABA neurons. Yet, preferential inputs to LC-GABA neurons have been reported in previous experiments studying PFC inputs. Inactivation of the PFC in rats shows an increase in firing rate in the LC (Sara and Hervé-Minvielle, 1995), and axonal photo-activation of PFC inputs in the LC decreases baseline LC-mediated arousal levels (Breton-Provencher and Sur, 2019). Based on tracing experiments (Figure 2C), there are several other regions that likely exert preferential inputs to LC-GABA neurons, such as the superior colliculus or the intermediate reticular nucleus, but the function and nature of these input regions on the LC have been largely unexplored.
Figure 2. Circuits controlling local inhibition of LC-NE+ neurons. (A) Illustration of a coronal view of the LC and medial pericoeruleus area showing the location of LC-GABA and -NE neurons. (B) Distal inputs to LC-GABA neurons obtained by retrograde tracing using rabies virus targeted at LC-NE neurons. Input regions are grouped by: cortex (CTX), striatum (STR), pallidum (PAL), hypothalamus (HY), amygdala (AMY), midbrain (MB), medulla (MY), and cerebellum (CV). The thickness of each line represents the strength of the input from each region. Input strength was calculated by counting the number of cells retrogradely labeled in a specific area and dividing it by the total number of retrogradely labeled neurons. Regions providing less than 0.5% of inputs were left out of this diagram. Local inputs from the pons were also excluded. (C) Comparison between the input strength to LC-NE versus LC-GABA for all distal brain regions targeting the LC area. The darkness of each square in the top graph represents the fraction of input each region contributes to total input. Regions are divided between three types depending on whether they send coincident or non-coincident inputs to LC-NE or LC-GABA neurons. See Figure 1 for a list of abbreviations. Data in (B,C) from Breton-Provencher and Sur (2019).
Whether the other neuronal subtypes in the LC shell – e.g., glutamatergic, neuropeptide-S-expressing, or cholinergic – form direct connections with LC-NE neurons, or play a role in shaping LC-NE activity, remains unknown. However, these neuronal subtypes are predominantly active during wakefulness (Boucetta et al., 2014; Cox et al., 2016), indicating that they could be involved in spontaneous or learned behaviors. Future research using physiological recordings and manipulations targeting these different neuronal cell-types will enable a more comprehensive understanding of LC local circuits.
LC-Ne Regulation of Arousal and Attention
One of the strongest behavioral correlates of LC-NE activity is its link with vigilance states. LC-NE neurons are silent during REM sleep, display low levels of activity during non-REM sleep, and are most active during wakefulness (Aston-Jones and Bloom, 1981a; Swift et al., 2018; Hayat et al., 2020). Manipulating LC activity modulates vigilance state. High levels of photo-activation of LC-NE neurons, mimicking LC phasic activity, promotes sleep-to-wake transitions (Carter et al., 2010), while lower photo-activation levels, resembling increased tonic activity, impair the power of theta and delta frequencies measured with EEG during sleep (Swift et al., 2018). Similarly, minimal photo-activation of tonic LC-NE increases the probability of sensory-evoked awakenings (Hayat et al., 2020). On the other hand, reducing LC-NE activity with photo-inactivation decreases wakefulness durations (Carter et al., 2010). Together, these results suggest that LC-NE plays an important role in controlling vigilance states, likely as part of a complex network involving neurons from the brainstem, mid-brain, thalamus, and hypothalamus (Berridge, 2008; Lee and Dan, 2012; Gent et al., 2018).
The link between LC-NE activity and arousal is likely relevant for explaining the role of LC-NE in learned behaviors during wakefulness. LC activation tightly correlates with pupil size and arousal level in mice (Reimer et al., 2016; Breton-Provencher and Sur, 2019), monkeys (Joshi et al., 2016), and humans (Murphy et al., 2014; Elman et al., 2017; DiNuzzo et al., 2019). This activity of LC-NE neurons alone is sufficient to promote global arousal in mice, as photo-activation or -inhibition of LC-NE neurons during wakefulness increases or reduces arousal levels, respectively (Carter et al., 2010; Lovett-Barron et al., 2017; Breton-Provencher and Sur, 2019; Hayat et al., 2020). The mode of activation of LC-NE neurons seems to play a key role in arousal. Indeed, phasic activation over long periods (>1 h), but not tonic activation, of LC-NE activity increases arousal (Carter et al., 2010). Change in arousal can occur following phasic LC-NE activation by salient or novel sensory stimuli (Aston-Jones and Bloom, 1981b; Grant et al., 1988; Vankov et al., 1995; Takeuchi et al., 2016). Often, this phasic activation scales with the strength of behavioral action associated with the stimulus (Grant et al., 1988; Breton-Provencher and Sur, 2019). Optimal cognitive performance correlates with moderate levels of baseline LC-NE activity, while uncontrolled LC-NE activity can lead to hyper-arousal and anxiety behaviors (Valentino and Van Bockstaele, 2008; McCall et al., 2015, 2017; Li et al., 2018), exemplifying the inverted-U relationship between brain functions and NE activation (Yerkes and Dodson, 1908; Usher et al., 1999; Aston-Jones and Cohen, 2005; McGinley et al., 2015).
Arousal alters attention by suppressing low-salience stimuli while enhancing responses to highly salient or goal-directed information; accordingly, LC-NE is also thought to be critically involved in regulating attention through its brain-wide release (Lee et al., 2018). Older adults typically exhibit a decline in LC functional connectivity that correlates with an inability to suppress non-salient information during arousal (Lee et al., 2018). Global LC-mediated changes in arousal can alter attention via gain control, though the mechanism by which this gain control occurs remains unresolved. It has been shown that pharmacological blockade of NE activity impairs the membrane depolarization of cortical neurons that would naturally occur during high levels of arousal (Constantinople and Bruno, 2011; Polack et al., 2013; Schiemann et al., 2015). Arousal levels have also been shown to modulate microglial response to brain injury via β2 adrenergic receptors (Stowell et al., 2019). However, a detailed analysis of the cell types and neuronal subtypes being affected by NE during brain state changes is lacking. Moreover, we have a poor understanding of the degree of brain-wide modulation by LC-NE activity in vivo in awake behaving animals. Finally, defining the function of LC-NE activity as a global broadcast system of arousal might be too simplistic for understanding its role in learned behavior, as we discuss later with the emergence of modular functional data in the LC-NE system.
Activation of LC-NE Neurons During Learned Behavior
The role of LC-NE neurons extends beyond arousal, attention, and anxiety. Recordings or pharmacological manipulations of phasic NE activity suggest a dual involvement in behavior and cognition. First, LC activation is critical for sustained attention, as its phasic activity correlates with behavioral responses in learned behaviors (Bouret and Sara, 2004; Clayton et al., 2004; Rajkowski et al., 2004; Bouret and Richmond, 2009, 2015; Kalwani et al., 2014; Varazzani et al., 2015; Jahn et al., 2020). Non-targeted recordings in the LC show a transient increase in firing rate coinciding with behavioral response in tasks involving operant or instrumental conditioning. This increase prior to motor execution scales with the amount of effort or vigor exerted (Rajkowski et al., 2004; Varazzani et al., 2015), but also with expected reward size (Bouret and Richmond, 2015). During periods of poor behavioral performance, LC activity is decreased. Thus, it has been hypothesized that transient LC activity during a learned behavior is critical for maintaining focused attention on a task. Supporting this hypothesis, long-lasting blockade of LC activity slows reward seeking behaviors (Jahn et al., 2018), and pairing LC activity with a sensory stimulus improves this response (Martins and Froemke, 2015). Though there is abundant evidence for LC-NE activity facilitating behavioral execution, how this is achieved, especially in the context of other LC-NE functions, is an outstanding question in the field.
In addition to its role in facilitating behavioral execution, LC activation is critically involved in learning and memory. LC projections to the hippocampus, amygdala, and PFC influence spatial learning and memory formation (Kempadoo et al., 2016; Takeuchi et al., 2016; Uematsu et al., 2017; Wagatsuma et al., 2017; Kaufman et al., 2020). For example, during passive reinforcement learning, LC axonal activity in the hippocampus is associated with the timing of reward in spatial memory encoding (Kaufman et al., 2020). In tasks requiring active learning, LC activity correlates with an animal’s ability to form new stimulus/response associations: attentional set-shifting paradigms show that LC activity is involved in the learning of a new discrimination and in making extra-dimensional shifts (Devauges and Sara, 1990; Tait et al., 2007; Janitzky et al., 2015; Cope et al., 2019; Glennon et al., 2019). In rats performing a linear maze navigation task, when animals undergo an extra-dimensional shift requiring them to use visual cues instead of the previously indicative spatial cues, boosting NE pharmacologically accelerates the detection of the cue-shift and learning of a new cue (Devauges and Sara, 1990). It has also been shown that in rats performing a task requiring a shift in association to a new sensory cue within the same modality (intra-dimensional shift), LC spiking activity precedes prelimbic cortex spiking activity, suggesting that NE plays a critical role in the updating of task rules (Bouret and Sara, 2004). Further, decreasing LC-NE activity in the PFC over long durations with chemogenetics impairs a rat’s ability to disengage from a cognitive task (Tervo et al., 2014; Kane et al., 2017).
One mechanism by which LC-NE activity could enable learning is through encoding of environmental novelty. In naïve animals, electrophysiological measurements show that LC activity increases in response to novel or salient stimuli (Hervé-Minvielle and Sara, 1995; Vankov et al., 1995; Takeuchi et al., 2016; Breton-Provencher and Sur, 2019), and this activity quickly habituates (Hervé-Minvielle and Sara, 1995; Vankov et al., 1995). In trained animals, non-targeted measurements of LC spiking activity during learning of an operant conditioning task shows transient LC activity linked with unexpected reward (Bouret and Sara, 2004). Indeed, transient increase in LC activity may represent “unexpected uncertainty” and serve as a neural interrupt signal for unexpected events (Yu and Dayan, 2005; Dayan and Yu, 2006). However, it remains unclear whether increased LC activity in response to unexpected stimuli is causal for learning mechanisms, and how this might co-exist with its role in behavioral execution.
LC-NE Activity in Human Cognition
It has been widely observed that LC dynamics correlate with fluctuations in pupil diameter, both in human and animal studies (Murphy et al., 2014; Joshi et al., 2016; Reimer et al., 2016; Breton-Provencher and Sur, 2019). Many studies have taken advantage of this correlation to study the role of the LC in arousal (Krishnamurthy et al., 2017), learning (Nassar et al., 2012), and uncertainty (Urai et al., 2017) in human subjects. One such study suggests that LC-NE supports learning through global modulations of neural gain (Lee et al., 2018). High neural gain would enhance attention for selective stimulus features, whereas low gain would broaden attention, promoting processing of multiple stimulus features (Eldar et al., 2013; Lee et al., 2018). fMRI data show that periods of high gain and focused learning are associated with tightly clustered functional connectivity, suggesting that increased gain enhances selective interactions in brain networks (Lee et al., 2018). In addition to the evidence for LC-NE activity modulating feature processing through changes in the gain of global networks, other experiments have implicated LC-NE in learning through driving behavioral responses to uncertainty and volatility (Krishnamurthy et al., 2017; Urai et al., 2017; Lawson et al., 2021). Indirect measurements of NE activity in humans using pupillometry report a correlation between unexpected outcomes and increases in transient LC activity (Browning et al., 2015). Experiments using human subjects performing a probabilistic learning task show that blocking NE binding to β-adrenergic receptors globally causes subjects to rely more on their prior expectations when uncertainty is high (Lawson et al., 2021). Similarly, in a study using an auditory localization task where the predictability of the location varied over time, arousal was found to adjust the strength of perceptual biases in a changing environment (Krishnamurthy et al., 2017). These studies again highlight the potential roles of LC-NE in human cognition: driving attention and behavioral execution, and facilitating learning through updating of priors. Although pupil dilations strongly correlate with LC-NE activity, other neuromodulators such as acetylcholine and serotonin also show some degree of correlation with pupil size (Reimer et al., 2016; Larsen and Waters, 2018; Cazettes et al., 2021). Further tools to investigate neuromodulator dynamics will be required to disentangle the role of LC-NE from that of other neuromodulators in human behaviors.
Theories of LC Function
Two predominating theories attempt to explain the role of the LC in sensory-motor behavior: the adaptive gain theory (Aston-Jones and Cohen, 2005) and the network reset theory (Bouret and Sara, 2005; Yu and Dayan, 2005; Dayan and Yu, 2006). The adaptive gain theory seeks to explain the phasic and tonic modes of LC-NE activity. Phasic activity prevails during optimal behavioral performance, where transient increases in LC-NE activity facilitate task-specific decision processes (Usher et al., 1999; Aston-Jones and Cohen, 2005). In contrast, tonic activity prevails during periods of poor performance, where a general increase in LC-NE activity increases the gain of a network indiscriminately, making targeted circuits more responsive to any stimulus (Usher et al., 1999; Aston-Jones and Cohen, 2005). Thus, through adaptive gain, LC-NE activity optimizes the tradeoff between exploitation and exploration behaviors by switching between phasic and tonic activity, respectively. However, this theory does not explain which environmental stimuli would cue the LC to switch between these two modes. Further, this theory does not offer an explanation for whether different phasic activities exist temporally within tasks, and what the roles of these temporally distinct phasic activations might be. The network reset theory, on the other hand, suggests that contexts requiring a change in behavior transiently activate LC-NE neurons (Bouret and Sara, 2005; Yu and Dayan, 2005; Dayan and Yu, 2006). These activating contexts lead LC-NE neurons to induce widespread cortical arousal and reset network activity in the brain. Similarly, it has been suggested that LC-NE activity signals “unexpected uncertainty,” causing a reset in network activity to enable an updating of priors (Yu and Dayan, 2005; Dayan and Yu, 2006). By signaling the need to update priors, LC-NE would suppress top-down, expectation driven information in favor of bottom-up sensory-induced signals to enable learning and behavioral optimization. However, it is not clear how LC responses during execution would not lead to a network reset, and how phasically induced arousal relates to the commonly described tonic regulation by NE of arousal and internal state.
Though these theories of gain-modulation and network reset are not mutually exclusive, neither alone can fully explain the role of LC-NE in the brain, and little progress has been made in either refining or unifying them in the past 15 years. Recent technological advances and increased tool availability enabling precise measurements and manipulations of LC spiking activity in awake behaving mice present a means of evaluating these theories or advancing alternative proposals. Future studies on the role of LC-NE in learned behavior will require well-designed behavioral experiments to address these dual functions, while also considering the heterogeneous nature of LC activity and potential for spatial modularity of outputs.
Modular Outputs of the LC
One way to reconcile the divergent roles for LC-NE activity is suggested by recent evidence of spatial modularity within the LC-NE neuronal population (Chandler et al., 2019; Foote and Berridge, 2019; Poe et al., 2020). Historically, the LC has been considered a homogenous nucleus, such that NE is uniformly released to forebrain, brainstem, cerebellum, and spinal cord (Aston-Jones and Waterhouse, 2016). Yet, retrograde labeling shows that morphological characteristics and location within the LC nucleus is predictive of the particular region a LC neuron innervates (Loughlin et al., 1986a,b). Recent findings using projection-based viral genetic labeling has confirmed this view (Schwarz et al., 2015; Hirschberg et al., 2017; Uematsu et al., 2017; Plummer et al., 2020; Poe et al., 2020). Retrograde labeling of LC-NE neurons from the infralimbic, prelimbic, motor cortices or the amygdala, olfactory bulb, and medulla yields very few axons in other regions; these data suggest modularity in NE neuron outputs (Hirschberg et al., 2017; Uematsu et al., 2017; Plummer et al., 2020; Poe et al., 2020). However, other reports using the same approach demonstrate broad outputs from the LC, with broad collateralization of LC-NE axons in most brain regions excluding the olfactory bulb and medulla (Schwarz et al., 2015). Retrograde tracings also demonstrate limited modularity of LC-NE axons projecting to primary sensory cortices (Kim et al., 2016). Moreover, a high throughput method for mapping projections from the LC shows that LC neurons can preferentially target one cortical area, but also innervate large areas of cortex at reduced density (Kebschull et al., 2016). LC-NE neurons may also display functional modularity: simultaneous recording of LC neuron activity in anesthetized rats shows ensembles where the activity of subgroups of neurons correlates in time (Totah et al., 2018). So far, no data exist on whether functional modularity exists in awake behaving animals and whether this modularity originates from a combination of distant and local (e.g., LC-GABA) inputs.
Our current understanding of the LC-NE circuitry suggests at least partially distinct populations of LC-NE neurons with respect to their projection targets and functional organization (Figure 3A). These distinct LC-NE neurons would be able to confer target specific NE release through spatial modularity. In this spatial model of modularity, subpopulations of LC-NE neurons could receive different types of inputs. Distinct inputs to LC-NE neuron with highly convergent axons would enable local NE release (Figure 3B). In other behavioral contexts, inputs to LC-NE neurons with highly divergent axons, or global inputs to most LC-NE neurons, would enable global NE release (Figure 3B). Distinct outputs from LC neurons to cortical or subcortical targets would then encode distinct behavioral correlates. These proposals thus represent testable hypotheses of LC function in learned behaviors derived from spatial modularity of its inputs and outputs.
Figure 3. Spatiotemporal dynamics of the LC-NE system. (A) Anatomical organization of inputs to and outputs of LC. Note, LC-GABA neurons were included in this illustration as potential mechanism for nuancing local LC-NE activity, but, so far, no data exist on the relationship between local LC-GABA and specific LC-NE outputs. (B) Spatial modularity of LC-NE release. Top – Example activity of inputs to LC-NE neurons (orange), LC-NE neurons (blue), and local LC-NE release (purple). Bottom – Local versus global release of NE in output regions is dependent on which LC-NE neurons are activated by a given input. (C) Temporal modularity of LC-NE neuromodulation. Top – activity of local NE release in two given output regions and underlying neuronal activity in each region. Note, we assume that NE release is spatially global for simplicity. We also assume that NE neuromodulation increases neuronal activity in both target regions. Bottom – Due to differential NE receptor expression in brain regions, heterogenous expression of NE receptors on different types of brain cells, or the underlying function of a specific brain region, temporal integration can be local or global.
Molecular Heterogeneity in the LC
The suggestion of a modular input-output organization in the LC raises the question of whether LC-NE subpopulations exhibit different molecular signatures that could confer different functional properties. Again, though the LC has often been considered a homogenous nucleus, there is evidence to suggest that LC-NE neurons are a molecularly heterogeneous population. For example, though all LC neurons contain NE, separable subpopulations also contain other neuropeptides, such as Neuropeptide Y, galanin, and cocaine-and-amphetamine-regulated transcripts (Holets et al., 1988; Koylu et al., 1999; Simpson et al., 1999; Devoto et al., 2001, 2005). These subpopulations are found throughout the LC but have biased distributions; however, the anatomy of the projections from these neurons as well as the functional relevance of this co-release is uncharacterized (Holets et al., 1988). Galanin release from LC has been suggested to mediate active-coping behaviors, but whether this release occurs in projection-specific LC neurons is not known (Tillage et al., 2020). It has also been shown that LC projections release the neuromodulator dopamine in the hippocampus (Kempadoo et al., 2016; Takeuchi et al., 2016; Wagatsuma et al., 2017) and midline thalamus (Beas et al., 2018), where it plays a significant role in memory consolidation and stress responses, respectively. The extent to which dopamine is co-released from LC terminals in other areas of the brain, and how this co-release might affect other behaviors, remains unknown. In addition to having subsets of neurons capable of co-release of neuropeptides and neurotransmitters, LC neurons themselves appear to exhibit variability in neurotransmitter receptor expression, potentially enabling subpopulations to be activated by different inputs. LC neurons express receptors for many different neurotransmitters, such as GABA, orexin/hypocretin, and acetylcholine (Egan and North, 1986; Luque et al., 1994; Mansour et al., 1994; Marcus et al., 2001). In addition to these receptors, LC-NE neurons express several adrenoceptor subtypes, making LC-NE neurons themselves responsive to NE release. Indeed, it has been suggested that these adrenoceptor subtypes are differentially expressed throughout the LC, making subpopulations of LC-NE neurons differentially responsive to LC-NE activation (Young and Kuhar, 1980; Chamba et al., 1991). Like many other aspects of LC organization and function, the role of these different molecularly defined subpopulations remains unexplored, but provides a means by which LC-NE subpopulations could be differentially activated to facilitate distinct aspects of learned behavior.
Target-Specific Spatial and Temporal Effects of LC-NE Activity
Local integration of NE release by targets is an important way by which the activity of single LC neurons exhibiting multiple task components, with projections to multiple areas, can nonetheless be utilized for separate functions. Due to different NE receptor expression throughout the cortex (Goldman-Rakic et al., 1990; Schiemann et al., 2015), heterogenous expression of NE receptors on different types of brain cells (Hertz et al., 2010), or the underlying activity of a specific brain region, it is possible that the same NE signal can have different effects in output regions. Indeed, specific functions have been attributed to NE from region-specific pharmacological or optogenetic manipulations of LC activity. In subcortical regions, LC-NE activity in the hippocampus is critical for contextual memory formation (Wagatsuma et al., 2017) and place map plasticity (Kaufman et al., 2020). In the basolateral amygdala, photostimulating LC axons increases anxiety-like behavior (McCall et al., 2017). In the context of memory formation, inactivating LC projections to the basolateral amygdala impairs memory acquisition, while inactivating LC-NE projections in the infralimbic cortex impairs memory extinction (Uematsu et al., 2017). In cortical regions, pharmacological blockade of local NE receptors in visual, somatosensory, or motor cortex reduces membrane depolarization of neurons that is typically associated with state changes (Constantinople and Bruno, 2011; Polack et al., 2013; Schiemann et al., 2015). This depolarization in the presence of NE normally leads to an increase in firing rate of neurons and ultimately, increased sensory sensitivity (Polack et al., 2013). In prefrontal cortex regions such as the anterior cingulate cortex and limbic cortex, local manipulation of NE activity influences sustained attention (Berridge et al., 2012; Spencer and Berridge, 2019), memory (Berridge et al., 2012; Spencer and Berridge, 2019), decision making, and task acquisition (Tait et al., 2007; Tervo et al., 2014; Cope et al., 2019; Joshi and Gold, 2019). NE release in the anterior cingulate cortex promotes exploration and behavioral variation (Tervo et al., 2014). In a set-shifting task, manipulating NE activity in the prelimbic or infralimbic cortex improves the ability of animals to learn new associations (Tait et al., 2007; Cope et al., 2019). Importantly, most of these functions related to LC-NE activation are linked in time to specific components of internal state or behavior, so that NE release within a target enables the subsequent contribution of that target to brain state or function. Thus the different effects of LC-NE signals on processing and behavior not only reflect differential targeting of LC-NE outputs (spatial modularity) but also the differential processing of NE signals in time based on the functional role of the target as well as its regional and cellular NE receptor expression and availability (temporal modularity). In combination with spatial modularity, local and global temporal integration of NE signals in diverse targets is therefore an important mechanism of LC-NE function (Figure 3C).
Discussion – Future Prospects
Understanding the complex role of LC-NE signals in facilitating distinct aspects of behavior will require understanding the timescales on which LC-NE neurons are activated, how this activity affects performance in a learned behavior, and how these LC-NE signals are used by target regions to facilitate behavioral responses and learning. As in human studies manipulating the discriminability of a target, a learned behavior for studying LC-NE in model systems should incorporate different levels of sensory uncertainty. Thus, a task dependent on trial-history that incorporates sensory uncertainty and necessitates a goal-directed behavioral choice would enable a more unified understanding of the role of LC-NE in learned behaviors. Another important goal for the field is developing an understanding of how NE interacts with other neuromodulators to modulate brain states and behaviors. An established task that can be used across neuromodulatory systems would be well-suited for this goal. For example, in the cholinergic system, an auditory go/no-go task was used to show that cholinergic neurons encode reinforcement surprise, and that these responses scale with uncertainty (Hangya et al., 2015). Using varying tone intensities, the difficulty was modulated on a trial-by-trial basis to reflect different degrees of uncertainty. A similar task might be used to study how LC-NE neurons encode task-relevant responses and uncertainty, all within the same framework. Additionally, a novel two-alternative forced choice task in head fixed mice has been used to assay perceptual and value-based decision making (Burgess et al., 2017; Steinmetz et al., 2019). This task, which has been standardized across laboratories, could be applied toward studying the role of LC in learned behaviors. Behaviors such as these, incorporating both behavioral execution and learning, combined with cutting-edge tools such as optogenetics, targeted labeling of neuronal populations, deep-brain imaging, and imaging of NE receptor dynamics, combined with specific hypotheses of LC-NE function as proposed here, will help elucidate the role of LC-NE in cognition.
Conclusion
Despite the diverse roles of the LC in regulating arousal, attention, and facilitating more complex behaviors, our understanding of this nucleus is quite limited. Recent studies, however, are changing our understanding of the LC. What was formerly considered a homogenous nucleus exerting global, uniform influence over its many diverse target regions, is now suggested to be a heterogenous population of NE releasing cells, potentially exhibiting both spatial and temporal modularity that govern its function. These observations, combined with a rapidly expanding neuroscience toolkit, enable updating of existing theories, or potentially forming new ones, to explain the roles of LC-NE in learned behaviors.
Author Contributions
VB-P and GD wrote the initial draft. VB-P made all figures. All authors discussed the content and commented on the text and figures.
Funding
This work was supported by the NIH grants R01EY028219 and R01MH085802 (MS), PIIF (MS), and a postdoctoral fellowship from NSERC (PDF-48724-2016) (VB-P).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We thank Grayson Sipe, Kyle Jenks, Ning Leow, Jennifer Shih, Miriam Schwalm, and other members of the Sur laboratory for discussions and their contributions to the ideas presented in this review.
References
Arnsten, A. F. T. (2011). Catecholamine influences on dorsolateral prefrontal cortical networks. Biol. Psychiatry 69, e89–e99. doi: 10.1016/j.biopsych.2011.01.027
Arnsten, A. F. T., Raskind, M. A., Taylor, F. B., and Connor, D. F. (2015). The effects of stress exposure on prefrontal cortex: translating basic research into successful treatments for post-traumatic stress disorder. Neurobiol. Stress 1, 89–99. doi: 10.1016/j.ynstr.2014.10.002
Aston-Jones, G., and Bloom, F. E. (1981a). Activity of norepinephrine-containing locus coeruleus neurons in behaving rats anticipates fluctuations in the sleep-waking cycle. J. Neurosci. 1, 876–886. doi: 10.1523/jneurosci.01-08-00876.1981
Aston-Jones, G., and Bloom, F. E. (1981b). Norepinephrine-containing locus coeruleus neurons in behaving rats exhibit pronounced responses to non-noxious environmental stimuli. J. Neurosci. 1, 887–900. doi: 10.1523/jneurosci.01-08-00887.1981
Aston-Jones, G., and Cohen, J. D. (2005). An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Annu. Rev. Neurosci. 28, 403–450. doi: 10.1146/annurev.neuro.28.061604.135709
Aston-Jones, G., and Waterhouse, B. (2016). Locus coeruleus: from global projection system to adaptive regulation of behavior. Brain Res. 1645, 75–78. doi: 10.1016/j.brainres.2016.03.001
Aston-Jones, G., Zhu, Y., and Card, J. P. (2004). Numerous GABAergic afferents to locus ceruleus in the pericerulear dendritic zone: possible interneuronal pool. J. Neurosci. 24, 2313–2321. doi: 10.1523/JNEUROSCI.5339-03.2004
Beas, B. S., Wright, B. J., Skirzewski, M., Leng, Y., Hyun, J. H., Koita, O., et al. (2018). The locus coeruleus drives disinhibition in the midline thalamus via a dopaminergic mechanism. Nat. Neurosci. 21, 963–973. doi: 10.1038/s41593-018-0167-4
Berridge, C. W. (2008). Noradrenergic modulation of arousal. Brain Res. Rev. 58, 1–17. doi: 10.1016/j.brainresrev.2007.10.013
Berridge, C. W., Shumsky, J. S., Andrzejewski, M. E., McGaughy, J. A., Spencer, R. C., Devilbiss, D. M., et al. (2012). Differential sensitivity to psychostimulants across prefrontal cognitive tasks: differential involvement of noradrenergic α 1- and α 2-receptors. Biol. Psychiatry 71, 467–473. doi: 10.1016/j.biopsych.2011.07.022
Boucetta, S., Cissé, Y., Mainville, L., Morales, M., and Jones, B. E. (2014). Discharge profiles across the sleep-waking cycle of identified cholinergic, GABAergic, and glutamatergic neurons in the pontomesencephalic tegmentum of the rat. J. Neurosci. 34, 4708–4727. doi: 10.1523/JNEUROSCI.2617-13.2014
Bouret, S., and Richmond, B. J. (2009). Relation of locus coeruleus neurons in monkeys to Pavlovian and operant behaviors. J. Neurophysiol. 101, 898–911. doi: 10.1152/jn.91048.2008
Bouret, S., and Richmond, X. J. (2015). Sensitivity of locus ceruleus neurons to reward value for goal-directed actions. J. Neurosci. 35, 4005–4014. doi: 10.1523/JNEUROSCI.4553-14.2015
Bouret, S., and Sara, S. J. (2004). Reward expectation, orientation of attention and locus coeruleus-medial frontal cortex interplay during learning. Eur. J. Neurosci. 20, 791–802. doi: 10.1111/j.1460-9568.2004.03526.x
Bouret, S., and Sara, S. J. (2005). Network reset: a simplified overarching theory of locus coeruleus noradrenaline function. Trends Neurosci. 28, 574–582. doi: 10.1016/j.tins.2005.09.002
Breton-Provencher, V., and Sur, M. (2019). Active control of arousal by a locus coeruleus GABAergic circuit. Nat. Neurosci. 22, 218–228. doi: 10.1038/s41593-018-0305-z
Browning, M., Behrens, T. E., Jocham, G., O’Reilly, J. X., and Bishop, S. J. (2015). Anxious individuals have difficulty learning the causal statistics of aversive environments. Nat. Neurosci. 18, 590–596. doi: 10.1038/nn.3961
Burgess, C. P., Lak, A., Steinmetz, N. A., Zatka-Haas, P., Bai Reddy, C., Jacobs, E. A. K., et al. (2017). High-yield methods for accurate two-alternative visual psychophysics in head-fixed mice. Cell Rep. 20, 2513–2524. doi: 10.1016/j.celrep.2017.08.047
Carter, M. E., Yizhar, O., Chikahisa, S., Nguyen, H., Adamantidis, A., Nishino, S., et al. (2010). Tuning arousal with optogenetic modulation of locus coeruleus neurons. Nat. Neurosci. 13:1526. doi: 10.1038/nn.2682
Cazettes, F., Reato, D., Morais, J. P., Renart, A., and Mainen, Z. F. (2021). Phasic activation of dorsal raphe serotonergic neurons increases pupil size. Curr. Biol. 31, 192–197.e4. doi: 10.1016/j.cub.2020.09.090
Chamba, G., Weissmann, D., Rousset, C., Renaud, B., and Pujol, J. F. (1991). Distribution of alpha-1 and alpha-2 binding sites in the rat locus coeruleus. Brain Res. Bull. 26, 185–193. doi: 10.1016/0361-9230(91)90225-9
Chandler, D. J., Jensen, P., McCall, J. G., Pickering, A. E., Schwarz, L. A., and Totah, N. K. (2019). Redefining noradrenergic neuromodulation of behavior: impacts of a modular locus coeruleus architecture. J. Neurosci. 39, 8239–8249. doi: 10.1523/JNEUROSCI.1164-19.2019
Clayton, E. C., Rajkowski, J., Cohen, J. D., and Aston-Jones, G. (2004). Phasic activation of monkey locus ceruleus neurons by simple decisions in a forced-choice task. J. Neurosci. 24, 9914–9920. doi: 10.1523/JNEUROSCI.2446-04.2004
Constantinople, C. M., and Bruno, R. M. (2011). Effects and mechanisms of wakefulness on local cortical networks. Neuron 69, 1061–1068. doi: 10.1016/j.neuron.2011.02.040
Cope, Z. A., Vazey, E. M., Floresco, S. B., and Aston Jones, G. S. (2019). DREADD-mediated modulation of locus coeruleus inputs to mPFC improves strategy set-shifting. Neurobiol. Learn. Mem. 161, 1–11. doi: 10.1016/j.nlm.2019.02.009
Cox, J., Pinto, L., and Dan, Y. (2016). Calcium imaging of sleep-wake related neuronal activity in the dorsal pons. Nat. Commun. 7:10763. doi: 10.1038/ncomms10763
Dayan, P., and Yu, A. J. (2006). Phasic norepinephrine: a neural interrupt signal for unexpected events. Netw. Comput. Neural Syst. 17, 335–350. doi: 10.1080/09548980601004024
Delgado, P. L., and Moreno, F. A. (2000). Role of norepinephrine in depression. J. Clin. Psychiatry 61, 5–12.
Devauges, V., and Sara, S. J. (1990). Activation of the noradrenergic system facilitates an attentional shift in the rat. Behav. Brain Res. 39, 19–28. doi: 10.1016/0166-4328(90)90118-X
Devoto, P., Flore, G., Pani, L., and Gessa, G. L. (2001). Evidence for co-release of noradrenaline and dopamine from noradrenergic neurons in the cerebral cortex. Mol. Psychiatry 6, 657–664. doi: 10.1038/sj.mp.4000904
Devoto, P., Flore, G., Saba, P., Fà, M., and Gessa, G. L. (2005). Co-release of noradrenaline and dopamine in the cerebral cortex elicited by single train and repeated train stimulation of the locus coeruleus. BMC Neurosci. 6:31. doi: 10.1186/1471-2202-6-31
DiNuzzo, M., Mascali, D., Moraschi, M., Bussu, G., Maugeri, L., Mangini, F., et al. (2019). Brain networks underlying eye’s pupil dynamics. Front. Neurosci. 13:965. doi: 10.3389/fnins.2019.00965
Egan, T. M., and North, R. A. (1986). Actions of acetylcholine and nicotine on rat locus coeruleus neurons in vitro. Neuroscience 19, 565–571. doi: 10.1016/0306-4522(86)90281-2
Eldar, E., Cohen, J. D., and Niv, Y. (2013). The effects of neural gain on attention and learning. Nat. Neurosci. 16, 1146–1153. doi: 10.1038/nn.3428
Elman, J. A., Panizzon, M. S., Hagler, D. J., Eyler, L. T., Granholm, E. L., Fennema-Notestine, C., et al. (2017). Task-evoked pupil dilation and BOLD variance as indicators of locus coeruleus dysfunction. Cortex 97, 60–69. doi: 10.1016/j.cortex.2017.09.025
Engelhard, B., Finkelstein, J., Cox, J., Fleming, W., Jang, H. J., Ornelas, S., et al. (2019). Specialized coding of sensory, motor and cognitive variables in VTA dopamine neurons. Nature 570, 509–513. doi: 10.1038/s41586-019-1261-9
Foote, S. L., and Berridge, C. W. (2019). New developments and future directions in understanding locus coeruleus – Norepinephrine (LC-NE) function. Brain Res. 1709, 81–84. doi: 10.1016/j.brainres.2018.09.033
Friedman, J. I., Adler, D. N., and Davis, K. L. (1999). The role of norepinephrine in the pathophysiology of cognitive disorders: potential applications to the treatment of cognitive dysfunction in schizophrenia and Alzheimer’s disease. Biol. Psychiatry 46, 1243–1252. doi: 10.1016/S0006-3223(99)00232-2
Gent, T. C., Bandarabadi, M., Herrera, C. G., and Adamantidis, A. R. (2018). Thalamic dual control of sleep and wakefulness. Nat. Neurosci. 21, 974–984. doi: 10.1038/s41593-018-0164-7
Glennon, E., Carcea, I., Martins, A. R. O., Multani, J., Shehu, I., Svirsky, M. A., et al. (2019). Locus coeruleus activation accelerates perceptual learning. Brain Res. 1709, 39–49. doi: 10.1016/j.brainres.2018.05.048
Goldman-Rakic, P. S., Lidow, M. S., and Gallager, D. W. (1990). Overlap of dopaminergic, adrenergic, and serotoninergic receptors and complementarity of their subtypes in primate prefrontal cortex. J. Neurosci. 10, 2125–2138. doi: 10.1523/jneurosci.10-07-02125.1990
Grant, S. J., Aston-Jones, G., and Redmond, D. E. (1988). Responses of primate locus coeruleus neurons to simple and complex sensory stimuli. Brain Res. Bull. 21, 401–410. doi: 10.1016/0361-9230(88)90152-9
Hangya, B., Ranade, S. P., Lorenc, M., and Kepecs, A. (2015). Central cholinergic neurons are rapidly recruited by reinforcement feedback. Cell 162, 1155–1168. doi: 10.1016/j.cell.2015.07.057
Hayat, H., Regev, N., Matosevich, N., Sales, A., Paredes-Rodriguez, E., Krom, A. J., et al. (2020). Locus coeruleus norepinephrine activity mediates sensory-evoked awakenings from sleep. Sci. Adv. 6:eaaz4232. doi: 10.1126/sciadv.aaz4232
Hertz, L., Lovatt, D., Goldman, S. A., and Nedergaard, M. (2010). Adrenoceptors in brain: cellular gene expression and effects on astrocytic metabolism and [Ca2+]i. Neurochem. Int. 57, 411–420. doi: 10.1016/j.neuint.2010.03.019
Hervé-Minvielle, A., and Sara, S. (1995). Rapid habituation of auditory responses of locus coeruleus cells in anaesthetized and awake rats. Neuroreport 6, 1363–1368. doi: 10.1097/00001756-199507100-00001
Hirschberg, S., Li, Y., Randall, A., Kremer, E. J., and Pickering, A. E. (2017). Functional dichotomy in spinal-vs prefrontal-projecting locus coeruleus modules splits descending noradrenergic analgesia from ascending aversion and anxiety in rats. Elife 6:e29808. doi: 10.7554/eLife.29808.001
Holets, V. R., Hökfelt, T., Rökaeus, Å, Terenius, L., and Goldstein, M. (1988). Locus coeruleus neurons in the rat containing neuropeptide Y, tyrosine hydroxylase or galanin and their efferent projections to the spinal cord, cerebral cortex and hypothalamus. Neuroscience 24, 893–906. doi: 10.1016/0306-4522(88)90076-0
Jahn, C. I., Gilardeau, S., Varazzani, C., Blain, B., Sallet, J., Walton, M. E., et al. (2018). Dual contributions of noradrenaline to behavioural flexibility and motivation. Psychopharmacology 235, 2687–2702. doi: 10.1007/s00213-018-4963-z
Jahn, C. I., Varazzani, C., Sallet, J., Walton, M. E., and Bouret, S. (2020). Noradrenergic but not dopaminergic neurons signal task state changes and predict reengagement after a failure. Cereb. Cortex 30, 4979–4994. doi: 10.1093/cercor/bhaa089
Janitzky, K., Lippert, M. T., Engelhorn, A., Tegtmeier, J., Goldschmidt, J., Heinze, H. J., et al. (2015). Optogenetic silencing of locus coeruleus activity in mice impairs cognitive flexibility in an attentional set-shifting task. Front. Behav. Neurosci. 9:286. doi: 10.3389/fnbeh.2015.00286
Jin, X., Li, S., Bondy, B., Zhong, W., Oginsky, M. F., Wu, Y., et al. (2016). Identification of a group of GABAergic neurons in the dorsomedial area of the locus coeruleus. PLoS One 11:e0146470. doi: 10.1371/journal.pone.0146470
Jodo, E., Chiang, C., and Aston-Jones, G. (1998). Potent excitatory influence of prefrontal cortex activity on noradrenergic locus coeruleus neurons. Neuroscience 83, 63–79. doi: 10.1016/S0306-4522(97)00372-2
Jones, B. E., and Moore, R. Y. (1977). Ascending projections of the locus coeruleus in the rat. II. autoradiographic study. Brain Res. 127, 23–53. doi: 10.1016/0006-8993(77)90378-X
Jones, B. E., and Yang, T. −Z. (1985). The efferent projections from the reticular formation and the locus coeruleus studied by anterograde and retrograde axonal transport in the rat. J. Comp. Neurol. 242, 56–92. doi: 10.1002/cne.902420105
Joshi, S., and Gold, J. I. (2019). Context-dependent relationships between locus coeruleus firing patterns and coordinated neural activity in the anterior cingulate cortex. bioRxiv 2020.09.26.314831. doi: 10.1101/2020.09.26.314831
Joshi, S., Li, Y., Kalwani, R. M., and Gold, J. I. (2016). Relationships between pupil diameter and neuronal activity in the locus coeruleus, colliculi, and cingulate cortex article relationships between pupil diameter and neuronal activity in the locus coeruleus, colliculi, and cingulate cortex. Neuron 89, 221–234. doi: 10.1016/j.neuron.2015.11.028
Kalwani, R. M., Joshi, S., and Gold, J. I. (2014). Phasic activation of individual neurons in the locus ceruleus/subceruleus complex of monkeys reflects rewarded decisions to go but not stop. J. Neurosci. 34, 13656–13669. doi: 10.1523/JNEUROSCI.2566-14.2014
Kane, G. A., Vazey, E. M., Wilson, R. C., Shenhav, A., Daw, N. D., Aston-Jones, G., et al. (2017). Increased locus coeruleus tonic activity causes disengagement from a patch-foraging task. Cogn. Affect. Behav. Neurosci. 17, 1073–1083. doi: 10.3758/s13415-017-0531-y
Kaufman, A. M., Geiller, T., and Losonczy, A. (2020). A role for the locus coeruleus in hippocampal CA1 place cell reorganization during spatial reward learning. Neuron 105, 1018–1026. doi: 10.1016/j.neuron.2019.12.029
Kebschull, J. M., Garcia da Silva, P., Reid, A. P., Peikon, I. D., Albeanu, D. F., and Zador, A. M. (2016). High-throughput mapping of single-neuron projections by sequencing of barcoded RNA. Neuron 91, 975–987. doi: 10.1016/j.neuron.2016.07.036
Kempadoo, K. A., Mosharov, E. V., Choi, S. J., Sulzer, D., and Kandel, E. R. (2016). Dopamine release from the locus coeruleus to the dorsal hippocampus promotes spatial learning and memory. Proc. Natl. Acad. Sci. U.S.A. 113, 14835–14840. doi: 10.1073/pnas.1616515114
Kim, J., Jung, A., Jeong, D., Choi, I., Kim, K., Shin, S., et al. (2016). Selectivity of neuromodulatory projections from the basal forebrain and locus ceruleus to primary sensory cortices. J. Neurosci. 36, 5314–5327. doi: 10.1523/JNEUROSCI.4333-15.2016
Koylu, E. O., Smith, Y., Couceyro, P. R., and Kuhar, M. J. (1999). CART peptides colocalize with tyrosine hydroxylase neurons in rat locus coeruleus. Synapse 31, 309–311. doi: 10.1002/(SICI)1098-2396(19990315)31:4<309::AID-SYN10>3.0.CO;2-6
Krishnamurthy, K., Nassar, M. R., Sarode, S., and Gold, J. I. (2017). Arousal-related adjustments of perceptual biases optimize perception in dynamic environments. Nat. Hum. Behav. 1:0107. doi: 10.1038/s41562-017-0107
Kuo, C. C., Hsieh, J. C., Tsai, H. C., Kuo, Y. S., Yau, H. J., Chen, C. C., et al. (2020). Inhibitory interneurons regulate phasic activity of noradrenergic neurons in the mouse locus coeruleus and functional implications. J. Physiol. 598, 4003–4029. doi: 10.1113/JP279557
Larsen, R. S., and Waters, J. (2018). Neuromodulatory correlates of pupil dilation. Front. Neural Circuits 12:21. doi: 10.3389/fncir.2018.00021
Lawson, R. P., Bisby, J., Nord, C. L., Burgess, N., and Rees, G. (2021). The computational, pharmacological, and physiological determinants of sensory learning under uncertainty. Curr. Biol. 31, 163–172.
Lee, S. H., and Dan, Y. (2012). Neuromodulation of brain states. Neuron 76, 209–222. doi: 10.1016/j.neuron.2012.09.012
Lee, T. H., Greening, S. G., Ueno, T., Clewett, D., Ponzio, A., Sakaki, M., et al. (2018). Arousal increases neural gain via the locus coeruleus-noradrenaline system in younger adults but not in older adults. Nat. Hum. Behav. 2, 356–366. doi: 10.1038/s41562-018-0344-1
Li, L., Feng, X., Zhou, Z., Zhang, H., Shi, Q., Lei, Z., et al. (2018). Stress accelerates defensive responses to looming in mice and involves a locus coeruleus-superior colliculus projection. Curr. Biol. 28, 859–871. doi: 10.1016/j.cub.2018.02.005
Loughlin, S. E., Foote, S. L., and Bloom, F. E. (1986a). Efferent projections of nucleus locus coeruleus: topographic organization of cells of origin demonstrated by three-dimensional reconstruction. Neuroscience 18, 291–306. doi: 10.1016/0306-4522(86)90155-7
Loughlin, S. E., Foote, S. L., and Grzanna, R. (1986b). Efferent projections of nucleus locus coeruleus: morphologic subpopulations have different efferent targets. Neuroscience 18, 307–319. doi: 10.1016/0306-4522(86)90156-9
Lovett-Barron, M., Andalman, A. S., Allen, W. E., Vesuna, S., Kauvar, I., Burns, V. M., et al. (2017). Ancestral circuits for the coordinated modulation of brain state. Cell 171, 1411–1423. doi: 10.1016/j.cell.2017.10.021
Luque, J. M., Malherbe, P., and Richards, J. G. (1994). Localization of GABAA receptor subunit mRNAs in the rat locus coeruleus. Mol. Brain Res. 24, 219–226. doi: 10.1016/0169-328X(94)90135-X
Mansour, A., Fox, C. A., Burke, S., Meng, F., Thompson, R. C., Akil, H., et al. (1994). Mu, delta, and kappa opioid receptor mRNA expression in the rat CNS: an in situ hybridization study. J. Comp. Neurol. 350, 412–438. doi: 10.1002/cne.903500307
Marcus, J. N., Aschkenasi, C. J., Lee, C. E., Chemelli, R. M., Saper, C. B., Yanagisawa, M., et al. (2001). Differential expression of Orexin receptors 1 and 2 in the rat brain. J. Comp. Neurol. 435, 6–25. doi: 10.1002/cne.1190
Martins, A. R. O., and Froemke, R. C. (2015). Coordinated forms of noradrenergic plasticity in the locus coeruleus and primary auditory cortex. Nat. Neurosci. 18, 1483–1492. doi: 10.1038/nn.4090
McCall, J. G., Al-Hasani, R., Siuda, E. R., Hong, D. Y., Norris, A. J., Ford, C. P., et al. (2015). CRH engagement of the locus coeruleus noradrenergic system mediates stress-induced anxiety. Neuron 87, 605–620. doi: 10.1016/j.neuron.2015.07.002
McCall, J. G., Siuda, E. R., Bhatti, D. L., Lawson, L. A., McElligott, Z. A., Stuber, G. D., et al. (2017). Locus coeruleus to basolateral amygdala noradrenergic projections promote anxiety-like behavior. Elife 6:e18247. doi: 10.7554/eLife.18247
McGinley, M. J., David, S. V., and McCormick, D. A. (2015). Cortical membrane potential signature of optimal states for sensory signal detection. Neuron 87, 179–192. doi: 10.1016/j.neuron.2015.05.038
Murphy, P. R., O’Connell, R. G., O’Sullivan, M., Robertson, I. H., and Balsters, J. H. (2014). Pupil diameter covaries with BOLD activity in human locus coeruleus. Hum. Brain Mapp. 35, 4140–4154. doi: 10.1002/hbm.22466
Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B., and Gold, J. I. (2012). Rational regulation of learning dynamics by pupil-linked arousal systems. Nat. Neurosci. 15:1040. doi: 10.1038/nn.3130
Nomura, S., Bouhadana, M., Morel, C., Faure, P., Cauli, B., Lambolez, B., et al. (2014). Noradrenalin and dopamine receptors both control cAMP-PKA signaling throughout the cerebral cortex. Front. Cell. Neurosci. 8:247. doi: 10.3389/fncel.2014.00247
Pickel, V. M., Segal, M., and Bloom, F. E. (1974). A radioautographic study of the efferent pathways of the nucleus locus coeruleus. J. Comp. Neurol. 155, 15–41. doi: 10.1002/cne.901550103
Plummer, N. W., Chandler, D. J., Powell, J. M., Scappini, E. L., Waterhouse, B. D., and Jensen, P. (2020). An intersectional viral-genetic method for fluorescent tracing of axon collaterals reveals details of noradrenergic locus coeruleus structure. eNeuro 7:ENEURO.0010-20.2020. doi: 10.1523/ENEURO.0010-20.2020
Poe, G. R., Foote, S., Eschenko, O., Johansen, J. P., Bouret, S., Aston-Jones, G., et al. (2020). Locus coeruleus: a new look at the blue spot. Nat. Rev. Neurosci. 21, 644–659. doi: 10.1038/s41583-020-0360-9
Polack, P. O., Friedman, J., and Golshani, P. (2013). Cellular mechanisms of brain state-dependent gain modulation in visual cortex. Nat. Neurosci. 16, 1331–1339. doi: 10.1038/nn.3464
Rajkowski, J., Majczynski, H., Clayton, E., and Aston-Jones, G. (2004). Activation of monkey locus coeruleus neurons varies with difficulty and performance in a target detection task. J. Neurophysiol. 92, 361–371. doi: 10.1152/jn.00673.2003
Reimer, J., McGinley, M. J., Liu, Y., Rodenkirch, C., Wang, Q., McCormick, D. A., et al. (2016). Pupil fluctuations track rapid changes in adrenergic and cholinergic activity in cortex. Nat. Commun. 7:13289. doi: 10.1038/ncomms13289
Reyes, B. A. S., Zitnik, G., Foster, C., van Bockstaele, E. J., and Valentino, R. J. (2015). Social stress engages neurochemically-distinct afferents to the rat locus coeruleus depending on coping strategy. eNeuro 2:ENEURO.0042-15.2015. doi: 10.1523/ENEURO.0042-15.2015
Sara, S. J. (2009). The locus coeruleus and noradrenergic modulation of cognition. Nat. Rev. Neurosci. 10, 211–223. doi: 10.1038/nrn2573
Sara, S. J., and Bouret, S. (2012). Orienting and reorienting: the locus coeruleus mediates cognition through arousal. Neuron 76, 130–141. doi: 10.1016/j.neuron.2012.09.011
Sara, S. J., and Hervé-Minvielle, A. (1995). Inhibitory influence of frontal cortex on locus coeruleus neurons. Proc. Natl. Acad. Sci. U.S.A. 92, 6032–6036. doi: 10.1073/pnas.92.13.6032
Schiemann, J., Puggioni, P., Dacre, J., Pelko, M., Domanski, A., vanRossum, M. C. W., et al. (2015). Cellular mechanisms underlying behavioral state-dependent bidirectional modulation of motor cortex output. Cell Rep. 11, 1319–1330. doi: 10.1016/j.celrep.2015.04.042
Schultz, W. (1998). Predictive reward signal of dopamine neurons. J. Neurophysiol. 80, 1–27. doi: 10.1152/jn.1998.80.1.1
Schultz, W. (2016). Dopamine reward prediction-error signalling: a two-component response. Nat. Rev. Neurosci. 17:183. doi: 10.1038/nrn.2015.26
Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593–1599. doi: 10.1126/science.275.5306.1593
Schwarz, L. A., Miyamichi, K., Gao, X. J., Beier, K. T., Weissbourd, B., Deloach, K. E., et al. (2015). Viral-genetic tracing of the input-output organization of a central noradrenaline circuit. Nature 524, 88–92. doi: 10.1038/nature14600
Sharma, Y., Xu, T., Graf, W. M., Fobbs, A., Sherwood, C. C., Hof, P. R., et al. (2010). Comparative anatomy of the locus coeruleus in humans and nonhuman primates. J. Comp. Neurol. 518, 963–971. doi: 10.1002/cne.22249
Simpson, K. L., Waterhouse, B. D., and Lin, R. C. S. (1999). Origin, distribution, and morphology of galaninergic fibers in the rodent trigeminal system. J. Comp. Neurol. 411, 524–534. doi: 10.1002/(SICI)1096-9861(19990830)411:3<524::AID-CNE13>3.0.CO;2-X
Spencer, R. C., and Berridge, C. W. (2019). Receptor and circuit mechanisms underlying differential procognitive actions of psychostimulants. Neuropsychopharmacology 44, 1820–1827. doi: 10.1038/s41386-019-0314-y
Steinmetz, N. A., Zatka-Haas, P., Carandini, M., and Harris, K. D. (2019). Distributed coding of choice, action and engagement across the mouse brain. Nature 576, 266–273. doi: 10.1038/s41586-019-1787-x
Stowell, R. D., Sipe, G. O., Dawes, R. P., Batchelor, H. N., Lordy, K. A., Whitelaw, B. S., et al. (2019). Noradrenergic signaling in the wakeful state inhibits microglial surveillance and synaptic plasticity in the mouse visual cortex. Nat. Neurosci. 22, 1782–1792. doi: 10.1038/s41593-019-0514-0
Swift, K. M., Gross, B. A., Frazer, M. A., Bauer, D. S., Clark, K. J. D., Vazey, E. M., et al. (2018). Abnormal locus coeruleus sleep activity alters sleep signatures of memory consolidation and impairs place cell stability and spatial memory. Curr. Biol. 28, 3599–3609. doi: 10.1016/j.cub.2018.09.054
Tabansky, I., Liang, Y., Frankfurt, M., Daniels, M. A., Harrigan, M., Stern, S., et al. (2018). Molecular profiling of reticular gigantocellularis neurons indicates that eNOS modulates environmentally dependent levels of arousal. Proc. Natl. Acad. Sci. U.S.A. 115, E6900–E6909. doi: 10.1073/pnas.1806123115
Tait, D. S., Brown, V. J., Farovik, A., Theobald, D. E., Dalley, J. W., and Robbins, T. W. (2007). Lesions of the dorsal noradrenergic bundle impair attentional set-shifting in the rat. Eur. J. Neurosci. 25, 3719–3724. doi: 10.1111/j.1460-9568.2007.05612.x
Takeuchi, T., Duszkiewicz, A. J., Sonneborn, A., Spooner, P. A., Yamasaki, M., Watanabe, M., et al. (2016). Locus coeruleus and dopaminergic consolidation of everyday memory. Nature 537, 357–362. doi: 10.1038/nature19325
Tervo, D. G. R., Proskurin, M., Manakov, M., Kabra, M., Vollmer, A., Branson, K., et al. (2014). Behavioral variability through stochastic choice and its gating by anterior cingulate cortex. Cell 159, 21–32. doi: 10.1016/j.cell.2014.08.037
Tillage, R. P., Sciolino, N. R., Plummer, N. W., Lustberg, D., Liles, L. C., Hsiang, M., et al. (2020). Elimination of galanin synthesis in noradrenergic neurons reduces galanin in select brain areas and promotes active coping behaviors. Brain Struct. Funct. 225, 785–803. doi: 10.1007/s00429-020-02035-4
Totah, N. K., Neves, R. M., Panzeri, S., Logothetis, N. K., and Eschenko, O. (2018). The locus coeruleus is a complex and differentiated neuromodulatory system. Neuron 99, 1055–1068.e6. doi: 10.1016/j.neuron.2018.07.037
Uematsu, A., Tan, B. Z., Ycu, E. A., Cuevas, J. S., Koivumaa, J., Junyent, F., et al. (2017). Modular organization of the brainstem noradrenaline system coordinates opposing learning states. Nat. Neurosci. 20, 1602–1611. doi: 10.1038/nn.4642
Urai, A. E., Braun, A., and Donner, T. H. (2017). Pupil-linked arousal is driven by decision uncertainty and alters serial choice bias. Nat. Commun. 8:14637. doi: 10.1038/ncomms14637
Usher, M., Cohen, J. D., Servan-Schreiber, D., Rajkowski, J., and Aston-Jones, G. (1999). The role of locus coeruleus in the regulation of cognitive performance. Science 283, 549–554. doi: 10.1126/science.283.5401.549
Valentino, R. J., and Van Bockstaele, E. (2008). Convergent regulation of locus coeruleus activity as an adaptive response to stress. Eur. J. Pharmacol. 583, 194–203. doi: 10.1016/j.ejphar.2007.11.062
Vankov, A., Hervé−Minvielle, A., and Sara, S. J. (1995). Response to novelty and its rapid habituation in locus coeruleus neurons of the freely exploring rat. Eur. J. Neurosci. 7, 1180–1187. doi: 10.1111/j.1460-9568.1995.tb01108.x
Varazzani, C., San-Galli, A., Gilardeau, S., and Bouret, S. (2015). Noradrenaline and dopamine neurons in the reward/effort trade-off: a direct electrophysiological comparison in behaving monkeys. J. Neurosci. 35, 7866–7877. doi: 10.1523/JNEUROSCI.0454-15.2015
Wagatsuma, A., Okuyama, T., Sun, C., Smith, L. M., Abe, K., and Tonegawa, S. (2017). Locus coeruleus input to hippocampal CA3 drives single-trial learning of a novel context. Proc. Natl. Acad. Sci. U.S.A. 115, E310–E316. doi: 10.1073/pnas.1714082115
Weinshenker, D. (2008). Functional consequences of locus coeruleus degeneration in alzheimers disease. Curr. Alzheimer Res. 5, 342–345. doi: 10.2174/156720508784533286
Xu, Y. L., Reinscheid, R. K., Huitron-Resendiz, S., Clark, S. D., Wang, Z., Lin, S. H., et al. (2004). Neuropeptide S: a neuropeptide promoting arousal and anxiolytic-like effects. Neuron 43, 487–497. doi: 10.1016/j.neuron.2004.08.005
Yerkes, R. M., and Dodson, J. D. (1908). The relation of strength of stimulus to rapidity of habit-formation. J. Comp. Neurol. Psychol. 18, 459–482. doi: 10.1002/cne.920180503
Young, W. S. III, and Kuhar, M. J. (1980). Noradrenergic alpha 1 and alpha 2 receptors: light microscopic autoradiographic localization. Proc. Natl. Acad. Sci. U.S.A. 77, 1696–1700.
Yu, A. J., and Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron 46, 681–692. doi: 10.1016/j.neuron.2005.04.026
Keywords: locus coeruleus, noradrenaline (norepinephrine), neuromodulation, learning, inhibition, arousal, learned behavior
Citation: Breton-Provencher V, Drummond GT and Sur M (2021) Locus Coeruleus Norepinephrine in Learned Behavior: Anatomical Modularity and Spatiotemporal Integration in Targets. Front. Neural Circuits 15:638007. doi: 10.3389/fncir.2021.638007
Received: 04 December 2020; Accepted: 03 May 2021;
Published: 07 June 2021.
Edited by:
Tommaso Pizzorusso, University of Florence, ItalyReviewed by:
Ying Zhang, Dalhousie University, CanadaTianyi Mao, Oregon Health & Science University, United States
Copyright © 2021 Breton-Provencher, Drummond and Sur. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Mriganka Sur, msur@mit.edu
†These authors have contributed equally to this work