Table of Contents Author Guidelines Submit a Manuscript
Neural Plasticity
Volume 2017, Article ID 6817349, 15 pages
https://doi.org/10.1155/2017/6817349
Review Article

Genesis and Maintenance of Attentional Biases: The Role of the Locus Coeruleus-Noradrenaline System

1Department of Psychology, University of British Columbia, 2136 West Mall, Vancouver, BC, Canada V6T 1Z4
2Djavad Mowafaghian Centre for Brain Health, University of British Columbia, 2215 Wesbrook Mall, Vancouver, BC, Canada V6T 1Z3

Correspondence should be addressed to Mana R. Ehlers; ac.cbu.hcysp@srelheanam

Received 13 January 2017; Revised 13 June 2017; Accepted 27 June 2017; Published 20 July 2017

Academic Editor: Niels Hansen

Copyright © 2017 Mana R. Ehlers and Rebecca M. Todd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. K. S. LaBar and R. Cabeza, “Cognitive neuroscience of emotional memory,” Nature Reviews. Neuroscience, vol. 7, no. 1, pp. 54–64, 2006. View at Publisher · View at Google Scholar · View at Scopus
  2. E. A. Kensinger and S. Corkin, “Memory enhancement for emotional words: are emotional words more vividly remembered than neutral words?” Memory & Cognition, vol. 31, no. 8, pp. 1169–1180, 2003. View at Publisher · View at Google Scholar
  3. L. Cahill and J. L. McGaugh, “Mechanisms of emotional arousal and lasting declarative memory,” Trends in Neurosciences, vol. 21, no. 7, pp. 294–299, 1998. View at Publisher · View at Google Scholar · View at Scopus
  4. J. Markovic, A. K. Anderson, and R. M. Todd, “Tuning to the significant: neural and genetic processes underlying affective enhancement of visual perception and memory,” Behavioural Brain Research, vol. 259, pp. 229–241, 2014. View at Publisher · View at Google Scholar · View at Scopus
  5. G. Pourtois, A. Schettino, and P. Vuilleumier, “Brain mechanisms for emotional influences on perception and attention: what is magic and what is not,” Biological Psychology, vol. 92, no. 3, pp. 492–512, 2013. View at Publisher · View at Google Scholar · View at Scopus
  6. L. Chelazzi, J. Eštočinová, R. Calletti et al., “Altering spatial priority maps via reward-based learning,” The Journal of Neuroscience, vol. 34, no. 25, pp. 8594–8604, 2014. View at Publisher · View at Google Scholar · View at Scopus
  7. S. L. Lim, S. Padmala, and L. Pessoa, “Affective learning modulates spatial competition during low-load attentional conditions,” Neuropsychologia, vol. 46, no. 5, pp. 1267–1278, 2008. View at Publisher · View at Google Scholar · View at Scopus
  8. S. L. Lim, S. Padmala, and L. Pessoa, “Segregating the significant from the mundane on a moment-to-moment basis via direct and indirect amygdala contributions,” Proceedings of the National Academy of Sciences of the United States of America, vol. 106, no. 39, pp. 16841–16846, 2009. View at Publisher · View at Google Scholar · View at Scopus
  9. K. Koch, J. McLean, R. Segev et al., “How much the eye tells the brain,” Current Biology, vol. 16, no. 14, pp. 1428–1434, 2006. View at Publisher · View at Google Scholar · View at Scopus
  10. R. M. Todd, W. A. Cunningham, A. K. Anderson, and E. Thompson, “Affect-biased attention as emotion regulation,” Trends in Cognitive Sciences, vol. 16, no. 7, pp. 365–372, 2012. View at Publisher · View at Google Scholar · View at Scopus
  11. Y. Bar-Haim, D. Lamy, L. Pergamin, M. J. Bakermans-Kranenburg, and M. H. van IJzendoorn, “Threat-related attentional bias in anxious and nonanxious individuals: a meta-analytic study,” Psychological Bulletin, vol. 133, no. 1, pp. 1–24, 2007. View at Publisher · View at Google Scholar · View at Scopus
  12. R. M. Todd, M. J. MacDonald, P. Sedge et al., “Soldiers with posttraumatic stress disorder see a world full of threat: magnetoencephalography reveals enhanced tuning to combat-related cues,” Biological Psychiatry, vol. 78, no. 12, pp. 821–829, 2015. View at Publisher · View at Google Scholar · View at Scopus
  13. A. L. Mahan and K. J. Ressler, “Fear conditioning, synaptic plasticity and the amygdala: implications for posttraumatic stress disorder,” Trends in Neurosciences, vol. 35, no. 1, pp. 24–35, 2012. View at Publisher · View at Google Scholar · View at Scopus
  14. A. D. Peckham, R. K. McHugh, and M. W. Otto, “A meta-analysis of the magnitude of biased attention in depression,” Depression and Anxiety, vol. 27, no. 12, pp. 1135–1142, 2010. View at Publisher · View at Google Scholar · View at Scopus
  15. B. A. Anderson, S. L. Leal, M. G. Hall, M. A. Yassa, and S. Yantis, “The attribution of value-based attentional priority in individuals with depressive symptoms,” Cognitive, Affective, & Behavioral Neuroscience, vol. 14, no. 4, pp. 1221–1227, 2014. View at Publisher · View at Google Scholar · View at Scopus
  16. B. A. Anderson, “What is abnormal about addiction-related attentional biases?” Drug and Alcohol Dependence, vol. 167, pp. 8–14, 2016. View at Publisher · View at Google Scholar · View at Scopus
  17. B. A. Anderson, M. L. Faulkner, J. J. Rilee, S. Yantis, and C. L. Marvel, “Attentional bias for nondrug reward is magnified in addiction,” Experimental and Clinical Psychopharmacology, vol. 21, no. 6, pp. 499–506, 2013. View at Publisher · View at Google Scholar · View at Scopus
  18. A. J. Waters, S. J. Heishman, C. Lerman, and W. Pickworth, “Enhanced identification of smoking-related words during the attentional blink in smokers,” Addictive Behaviors, vol. 32, no. 12, pp. 3077–3082, 2007. View at Publisher · View at Google Scholar · View at Scopus
  19. E. Fox, R. Russo, and K. Dutton, “Attentional bias for threat: evidence for delayed disengagement from emotional faces,” Cognition & Emotion, vol. 16, no. 3, pp. 355–379, 2002. View at Publisher · View at Google Scholar · View at Scopus
  20. C. MacLeod and A. Mathews, “Cognitive bias modification approaches to anxiety,” Annual Review of Clinical Psychology, vol. 8, pp. 189–217, 2012. View at Publisher · View at Google Scholar · View at Scopus
  21. K. Perez-Edgar, B. C. Reeb-Sutherland, J. M. McDermott et al., “Attention biases to threat link behavioral inhibition to social withdrawal over time in very young children,” Journal of Abnormal Child Psychology, vol. 39, no. 6, pp. 885–895, 2011. View at Publisher · View at Google Scholar · View at Scopus
  22. K. Perez-Edgar, Y. Bar-Haim, J. M. McDermott, A. Chronis-Tuscano, D. S. Pine, and N. A. Fox, “Attention biases to threat and behavioral inhibition in early childhood shape adolescent social withdrawal,” Emotion, vol. 10, no. 3, pp. 349–357, 2010. View at Publisher · View at Google Scholar · View at Scopus
  23. S. Morales, K. Perez-Edgar, and K. Buss, “Longitudinal relations among exuberance, externalizing behaviors, and attentional bias to reward: the mediating role of effortful control,” Developmental Science, vol. 19, no. 5, pp. 853–862, 2016. View at Publisher · View at Google Scholar · View at Scopus
  24. Y. F. Chan, M. L. Dennis, and R. R. Funk, “Prevalence and comorbidity of major internalizing and externalizing problems among adolescents and adults presenting to substance abuse treatment,” Journal of Substance Abuse Treatment, vol. 34, no. 1, pp. 14–24, 2008. View at Publisher · View at Google Scholar · View at Scopus
  25. Y. Kotelnikova, J. LeMoult, S. V. Mackrell et al., “The serotonin transporter promoter variant, stress, and attentional biases in middle childhood,” Personality and Individual Differences, vol. 101, pp. 371–379, 2016. View at Publisher · View at Google Scholar · View at Scopus
  26. V. C. Johnson, K. R. Kryski, H. I. Sheikh, H. J. Smith, S. M. Singh, and E. P. Hayden, “The serotonin transporter promoter polymorphism moderates the continuity of behavioral inhibition in early childhood,” Development and Psychopathology, vol. 28, Part 1, no. 4, pp. 1103–1116, 2016. View at Publisher · View at Google Scholar · View at Scopus
  27. S. J. Sara, “The locus coeruleus and noradrenergic modulation of cognition,” Nature Reviews. Neuroscience, vol. 10, no. 3, pp. 211–223, 2009. View at Publisher · View at Google Scholar · View at Scopus
  28. S. J. Sara and S. Bouret, “Orienting and reorienting: the locus coeruleus mediates cognition through arousal,” Neuron, vol. 76, no. 1, pp. 130–141, 2012. View at Publisher · View at Google Scholar · View at Scopus
  29. M. Mather, D. Clewett, M. Sakaki, and C. W. Harley, “Norepinephrine ignites local hot spots of neuronal excitation: how arousal amplifies selectivity in perception and memory,” The Behavioral and Brain Sciences, vol. 39, article e200, 2016. View at Publisher · View at Google Scholar · View at Scopus
  30. G. Aston-Jones, J. Rajkowski, P. Kubiak, and T. Alexinsky, “Locus coeruleus neurons in monkey are selectively activated by attended cues in a vigilance task,” The Journal of Neuroscience, vol. 14, no. 7, pp. 4467–4480, 1994. View at Google Scholar
  31. G. Aston-Jones, J. Rajkowski, and P. Kubiak, “Conditioned responses of monkey locus coeruleus neurons anticipate acquisition of discriminative behavior in a vigilance task,” Neuroscience, vol. 80, no. 3, pp. 697–715, 1997. View at Publisher · View at Google Scholar · View at Scopus
  32. S. Bouret and S. J. Sara, “Reward expectation, orientation of attention and locus coeruleus-medial frontal cortex interplay during learning,” The European Journal of Neuroscience, vol. 20, no. 3, pp. 791–802, 2004. View at Publisher · View at Google Scholar · View at Scopus
  33. G. Aston-Jones and J. D. Cohen, “Adaptive gain and the role of the locus coeruleus-norepinephrine system in optimal performance,” The Journal of Comparative Neurology, vol. 493, no. 1, pp. 99–110, 2005. View at Publisher · View at Google Scholar · View at Scopus
  34. E. Eldar, J. D. Cohen, and Y. Niv, “The effects of neural gain on attention and learning,” Nature Neuroscience, vol. 16, no. 8, pp. 1146–1153, 2013. View at Publisher · View at Google Scholar · View at Scopus
  35. G. Aston-Jones and J. D. Cohen, “An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance,” Annual Review of Neuroscience, vol. 28, pp. 403–450, 2005. View at Publisher · View at Google Scholar · View at Scopus
  36. Y. Manunta and J. M. Edeline, “Noradrenergic induction of selective plasticity in the frequency tuning of auditory cortex neurons,” Journal of Neurophysiology, vol. 92, no. 3, pp. 1445–1463, 2004. View at Publisher · View at Google Scholar · View at Scopus
  37. B. D. Waterhouse, F. M. Sessler, J. T. Cheng, D. J. Woodward, S. A. Azizi, and H. C. Moises, “New evidence for a gating action of norepinephrine in central neuronal circuits of mammalian brain,” Brain Research Bulletin, vol. 21, no. 3, pp. 425–432, 1988. View at Publisher · View at Google Scholar · View at Scopus
  38. R. M. Sullivan and D. A. Wilson, “The locus coeruleus, norepinephrine, and memory in newborns,” Brain Research Bulletin, vol. 35, no. 5-6, pp. 467–472, 1994. View at Publisher · View at Google Scholar · View at Scopus
  39. C. W. Berridge and B. D. Waterhouse, “The locus coeruleus-noradrenergic system: modulation of behavioral state and state-dependent cognitive processes,” Brain Research Brain Research Reviews, vol. 42, no. 1, pp. 33–84, 2003. View at Google Scholar
  40. R. M. Todd, M. R. Ehlers, D. J. Müller et al., “Neurogenetic variations in norepinephrine availability enhance perceptual vividness,” The Journal of Neuroscience, vol. 35, no. 16, pp. 6506–16, 2015. View at Publisher · View at Google Scholar · View at Scopus
  41. R. M. Todd, D. J. Müller, D. H. Lee et al., “Genes for emotion-enhanced remembering are linked to enhanced perceiving,” Psychological Science, vol. 24, no. 11, pp. 2244–2253, 2013. View at Publisher · View at Google Scholar · View at Scopus
  42. R. M. Todd, D. J. Müller, D. J. Palombo et al., “Deletion variant in the ADRA2B gene increases coupling between emotional responses at encoding and later retrieval of emotional memories,” Neurobiology of Learning and Memory, vol. 112, pp. 222–229, 2014. View at Publisher · View at Google Scholar · View at Scopus
  43. R. M. Todd, D. J. Palombo, B. Levine, and A. K. Anderson, “Genetic differences in emotionally enhanced memory,” Neuropsychologia, vol. 49, no. 4, pp. 734–744, 2011. View at Publisher · View at Google Scholar · View at Scopus
  44. S. R. Moore and R. A. Depue, “Neurobehavioral foundation of environmental reactivity,” Psychological Bulletin, vol. 142, no. 2, pp. 107–164, 2016. View at Publisher · View at Google Scholar · View at Scopus
  45. D. J. de Quervain, I. T. Kolassa, V. Ertl et al., “A deletion variant of the alpha2b-adrenoceptor is related to emotional memory in Europeans and Africans,” Nature Neuroscience, vol. 10, no. 9, pp. 1137–1139, 2007. View at Publisher · View at Google Scholar · View at Scopus
  46. K. M. Small, K. M. Brown, S. L. Forbes, and S. B. Liggett, “Polymorphic deletion of three intracellular acidic residues of the alpha 2B-adrenergic receptor decreases G protein-coupled receptor kinase-mediated phosphorylation and desensitization,” The Journal of Biological Chemistry, vol. 276, no. 7, pp. 4917–4922, 2001. View at Publisher · View at Google Scholar · View at Scopus
  47. R. M. Todd, D. Talmi, T. W. Schmitz, J. Susskind, and A. K. Anderson, “Psychophysical and neural evidence for emotion-enhanced perceptual vividness,” The Journal of Neuroscience, vol. 32, no. 33, pp. 11201–11212, 2012. View at Publisher · View at Google Scholar · View at Scopus
  48. J. E. Raymond, K. L. Shapiro, and K. M. Arnell, “Temporary suppression of visual processing in an RSVP task: an attentional blink?” Journal of Experimental Psychology Human Perception and Performance, vol. 18, no. 3, pp. 849–860, 1992. View at Google Scholar
  49. V. Di Lollo, J. Kawahara, S. M. Shahab Ghorashi, and J. T. Enns, “The attentional blink: resource depletion or temporary loss of control?” Psychological Research, vol. 69, no. 3, pp. 191–200, 2005. View at Publisher · View at Google Scholar · View at Scopus
  50. B. Roozendaal, B. S. McEwen, and S. Chattarji, “Stress, memory and the amygdala,” Nature Reviews. Neuroscience, vol. 10, no. 6, pp. 423–433, 2009. View at Publisher · View at Google Scholar · View at Scopus
  51. A. F. Arnsten, “The emerging neurobiology of attention deficit hyperactivity disorder: the key role of the prefrontal association cortex,” The Journal of Pediatrics, vol. 154, no. 5, article I-S43, 2009. View at Publisher · View at Google Scholar
  52. C. W. Berridge and A. F. Arnsten, “Psychostimulants and motivated behavior: arousal and cognition,” Neuroscience and Biobehavioral Reviews, vol. 37, Part A, no. 9, pp. 1976–1984, 2013. View at Publisher · View at Google Scholar · View at Scopus
  53. D. Lee, R. M. Todd, K. Gardhouse, B. Levine, A. K. Anderson et al., “Enhanced attentional capture in survivors of a single traumatic event,” in Society for Neuroscience Annual Meeting, San Diego, CA, USA, 2013. View at Google Scholar
  54. S. Lissek, J. Levenson, A. L. Biggs et al., “Elevated fear conditioning to socially relevant unconditioned stimuli in social anxiety disorder,” The American Journal of Psychiatry, vol. 165, no. 1, pp. 124–132, 2008. View at Publisher · View at Google Scholar · View at Scopus
  55. S. Lissek, A. S. Powers, E. B. McClure et al., “Classical fear conditioning in the anxiety disorders: a meta-analysis,” Behaviour Research and Therapy, vol. 43, no. 11, pp. 1391–1424, 2005. View at Publisher · View at Google Scholar · View at Scopus
  56. S. Lissek, S. J. Rabin, D. J. McDowell et al., “Impaired discriminative fear-conditioning resulting from elevated fear responding to learned safety cues among individuals with panic disorder,” Behaviour Research and Therapy, vol. 47, no. 2, pp. 111–118, 2009. View at Publisher · View at Google Scholar · View at Scopus
  57. S. Wilker, T. Elbert, and I. T. Kolassa, “The downside of strong emotional memories: how human memory-related genes influence the risk for posttraumatic stress disorder—a selective review,” Neurobiology of Learning and Memory, vol. 112, pp. 75–86, 2014. View at Publisher · View at Google Scholar · View at Scopus
  58. M. Field and W. M. Cox, “Attentional bias in addictive behaviors: a review of its development, causes, and consequences,” Drug and Alcohol Dependence, vol. 97, no. 1-2, pp. 1–20, 2008. View at Publisher · View at Google Scholar · View at Scopus
  59. B. A. Anderson, “The attention habit: how reward learning shapes attentional selection,” Annals of the new York Academy of Sciences, vol. 1369, no. 1, pp. 24–39, 2016. View at Publisher · View at Google Scholar · View at Scopus
  60. R. A. Rescorla, “Probability of shock in the presence and absence of CS in fear conditioning,” Journal of Comparative and Physiological Psychology, vol. 66, no. 1, pp. 1–5, 1968. View at Google Scholar
  61. C. Sehlmeyer, S. Schöning, P. Zwitserlood et al., “Human fear conditioning and extinction in neuroimaging: a systematic review,” PloS One, vol. 4, no. 6, article e5865, 2009. View at Publisher · View at Google Scholar · View at Scopus
  62. J. E. LeDoux, “Emotion circuits in the brain,” Annual Review of Neuroscience, vol. 23, pp. 155–184, 2000. View at Publisher · View at Google Scholar · View at Scopus
  63. M. Zorawski, C. A. Cook, C. M. Kuhn, and K. S. LaBar, “Sex, stress, and fear: individual differences in conditioned learning,” Cognitive, Affective, & Behavioral Neuroscience, vol. 5, no. 2, pp. 191–201, 2005. View at Publisher · View at Google Scholar · View at Scopus
  64. R. G. Phillips and J. E. LeDoux, “Differential contribution of amygdala and hippocampus to cued and contextual fear conditioning,” Behavioral Neuroscience, vol. 106, no. 2, pp. 274–285, 1992. View at Publisher · View at Google Scholar · View at Scopus
  65. S. Maren and G. J. Quirk, “Neuronal signalling of fear memory,” Nature Reviews. Neuroscience, vol. 5, no. 11, pp. 844–852, 2004. View at Publisher · View at Google Scholar · View at Scopus
  66. F. Sotres-Bayon, D. E. Bush, and J. E. LeDoux, “Emotional perseveration: an update on prefrontal-amygdala interactions in fear extinction,” Learning & Memory, vol. 11, no. 5, pp. 525–535, 2004. View at Publisher · View at Google Scholar · View at Scopus
  67. F. Sotres-Bayon and G. J. Quirk, “Prefrontal control of fear: more than just extinction,” Current Opinion in Neurobiology, vol. 20, no. 2, pp. 231–235, 2010. View at Publisher · View at Google Scholar · View at Scopus
  68. E. R. Samuels and E. Szabadi, “Functional neuroanatomy of the noradrenergic locus coeruleus: its roles in the regulation of arousal and autonomic function part II: physiological and pharmacological manipulations and pathological alterations of locus coeruleus activity in humans,” Current Neuropharmacology, vol. 6, no. 3, pp. 254–285, 2008. View at Publisher · View at Google Scholar · View at Scopus
  69. E. R. Samuels and E. Szabadi, “Functional neuroanatomy of the noradrenergic locus coeruleus: its roles in the regulation of arousal and autonomic function part I: principles of functional organisation,” Current Neuropharmacology, vol. 6, no. 3, pp. 235–253, 2008. View at Publisher · View at Google Scholar · View at Scopus
  70. I. Liberzon, S. F. Taylor, R. Amdur et al., “Brain activation in PTSD in response to trauma-related stimuli,” Biological Psychiatry, vol. 45, no. 7, pp. 817–826, 1999. View at Publisher · View at Google Scholar · View at Scopus
  71. A. Etkin and T. D. Wager, “Functional neuroimaging of anxiety: a meta-analysis of emotional processing in PTSD, social anxiety disorder, and specific phobia,” The American Journal of Psychiatry, vol. 164, no. 10, pp. 1476–1488, 2007. View at Publisher · View at Google Scholar · View at Scopus
  72. S. J. Lupien and B. S. McEwen, “The acute effects of corticosteroids on cognition: integration of animal and human model studies,” Brain Research. Brain Research Reviews, vol. 24, no. 1, pp. 1–27, 1997. View at Google Scholar
  73. D. A. Morilak, G. Barrera, D. J. Echevarria et al., “Role of brain norepinephrine in the behavioral response to stress,” Progress in Neuro-Psychopharmacology & Biological Psychiatry, vol. 29, no. 8, pp. 1214–1224, 2005. View at Publisher · View at Google Scholar · View at Scopus
  74. J. B. Rosen and J. Schulkin, “From normal fear to pathological anxiety,” Psychological Review, vol. 105, no. 2, pp. 325–350, 1998. View at Publisher · View at Google Scholar
  75. V. Rau, J. P. DeCola, and M. S. Fanselow, “Stress-induced enhancement of fear learning: an animal model of posttraumatic stress disorder,” Neuroscience and Biobehavioral Reviews, vol. 29, no. 8, pp. 1207–1223, 2005. View at Publisher · View at Google Scholar · View at Scopus
  76. T. D. Geracioti Jr., D. G. Baker, N. N. Ekhator et al., “CSF norepinephrine concentrations in posttraumatic stress disorder,” The American Journal of Psychiatry, vol. 158, no. 8, pp. 1227–1230, 2001. View at Publisher · View at Google Scholar · View at Scopus
  77. T. D. Geracioti Jr., D. G. Baker, J. W. Kasckow et al., “Effects of trauma-related audiovisual stimulation on cerebrospinal fluid norepinephrine and corticotropin-releasing hormone concentrations in post-traumatic stress disorder,” Psychoneuroendocrinology, vol. 33, no. 4, pp. 416–424, 2008. View at Publisher · View at Google Scholar · View at Scopus
  78. J. D. Bremner, R. B. Innis, C. K. Ng et al., “Positron emission tomography measurement of cerebral metabolic correlates of yohimbine administration in combat-related posttraumatic stress disorder,” Archives of General Psychiatry, vol. 54, no. 3, pp. 246–254, 1997. View at Publisher · View at Google Scholar
  79. J. Davidson, “Drug therapy of post-traumatic stress disorder,” The British Journal of Psychiatry, vol. 160, pp. 309–314, 1992. View at Publisher · View at Google Scholar
  80. V. G. Olson, H. R. Rockett, R. K. Reh et al., “The role of norepinephrine in differential response to stress in an animal model of posttraumatic stress disorder,” Biological Psychiatry, vol. 70, no. 5, pp. 441–448, 2011. View at Publisher · View at Google Scholar · View at Scopus
  81. F. B. Taylor, K. Lowe, C. Thompson et al., “Daytime prazosin reduces psychological distress to trauma specific cues in civilian trauma posttraumatic stress disorder,” Biological Psychiatry, vol. 59, no. 7, pp. 577–581, 2006. View at Publisher · View at Google Scholar · View at Scopus
  82. I. L. Petrakis, E. Ralevski, N. Desai et al., “Noradrenergic vs serotonergic antidepressant with or without naltrexone for veterans with PTSD and comorbid alcohol dependence,” Neuropsychopharmacology, vol. 37, no. 4, pp. 996–1004, 2012. View at Publisher · View at Google Scholar · View at Scopus
  83. H. J. van Marle, E. J. Hermans, S. Qin, and G. Fernández, “From specificity to sensitivity: how acute stress affects amygdala processing of biologically salient stimuli,” Biological Psychiatry, vol. 66, no. 7, pp. 649–655, 2009. View at Publisher · View at Google Scholar · View at Scopus
  84. J. L. McGaugh, “Memory—a century of consolidation,” Science, vol. 287, no. 5451, pp. 248–251, 2000. View at Google Scholar
  85. K. Nader, G. E. Schafe, and J. E. L. Doux, “Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval,” Nature, vol. 406, no. 6797, pp. 722–726, 2000. View at Publisher · View at Google Scholar · View at Scopus
  86. J. Debiec, D. E. Bush, and J. E. LeDoux, “Noradrenergic enhancement of reconsolidation in the amygdala impairs extinction of conditioned fear in rats—a possible mechanism for the persistence of traumatic memories in PTSD,” Depression and Anxiety, vol. 28, no. 3, pp. 186–193, 2011. View at Publisher · View at Google Scholar · View at Scopus
  87. K. Gamache, R. K. Pitman, and K. Nader, “Preclinical evaluation of reconsolidation blockade by clonidine as a potential novel treatment for posttraumatic stress disorder,” Neuropsychopharmacology, vol. 37, no. 13, pp. 2789–2796, 2012. View at Publisher · View at Google Scholar · View at Scopus
  88. N. I. Keren, C. T. Lozar, K. C. Harris, P. S. Morgan, and M. A. Eckert, “In vivo mapping of the human locus coeruleus,” NeuroImage, vol. 47, no. 4, pp. 1261–1267, 2009. View at Publisher · View at Google Scholar · View at Scopus
  89. S. Joshi, Y. Li, R. M. Kalwani, and J. I. Gold, “Relationships between pupil diameter and neuronal activity in the locus coeruleus, colliculi, and cingulate cortex,” Neuron, vol. 89, no. 1, pp. 221–234, 2016. View at Publisher · View at Google Scholar · View at Scopus
  90. M. A. Phillips, E. Szabadi, and C. M. Bradshaw, “Comparison of the effects of clonidine and yohimbine on pupillary diameter at different illumination levels,” British Journal of Clinical Pharmacology, vol. 50, no. 1, pp. 65–68, 2000. View at Publisher · View at Google Scholar · View at Scopus
  91. C. Varazzani, A. San-Galli, S. Gilardeau, and S. Bouret, “Noradrenaline and dopamine neurons in the reward/effort trade-off: a direct electrophysiological comparison in behaving monkeys,” The Journal of Neuroscience, vol. 35, no. 20, pp. 7866–7877, 2015. View at Publisher · View at Google Scholar · View at Scopus
  92. M. Mather, H. Joo Yoo, D. V. Clewett et al., “Higher locus coeruleus MRI contrast is associated with lower parasympathetic influence over heart rate variability,” NeuroImage, vol. 150, pp. 329–335, 2017. View at Publisher · View at Google Scholar
  93. K. Wakamatsu, K. Tabuchi, M. Ojika, F. A. Zucca, L. Zecca, and S. Ito, “Norepinephrine and its metabolites are involved in the synthesis of neuromelanin derived from the locus coeruleus,” Journal of Neurochemistry, vol. 135, no. 4, pp. 768–776, 2015. View at Publisher · View at Google Scholar · View at Scopus
  94. B. W. Balleine, “Sensation, incentive learning, and the motivational control of goal-directed action,” in Neurobiology of Sensation and Reward, J. A. Gottfried, Ed., CRC Press/Taylor & Francis, Boca Raton, FL, USA, 2011. View at Google Scholar
  95. B. J. Everitt and T. W. Robbins, “Neural systems of reinforcement for drug addiction: from actions to habits to compulsion,” Nature Neuroscience, vol. 8, no. 11, pp. 1481–1489, 2005. View at Publisher · View at Google Scholar · View at Scopus
  96. B. W. Balleine and A. Dickinson, “Goal-directed instrumental action: contingency and incentive learning and their cortical substrates,” Neuropharmacology, vol. 37, no. 4-5, pp. 407–419, 1998. View at Google Scholar
  97. B. J. Everitt and T. W. Robbins, “Drug addiction: updating actions to habits to compulsions ten years on,” Annual Review of Psychology, vol. 67, pp. 23–50, 2016. View at Publisher · View at Google Scholar · View at Scopus
  98. E. Dias-Ferreira, J. C. Sousa, I. Melo et al., “Chronic stress causes frontostriatal reorganization and affects decision-making,” Science, vol. 325, no. 5940, pp. 621–625, 2009. View at Publisher · View at Google Scholar · View at Scopus
  99. L. Schwabe and O. T. Wolf, “Socially evaluated cold pressor stress after instrumental learning favors habits over goal-directed action,” Psychoneuroendocrinology, vol. 35, no. 7, pp. 977–986, 2010. View at Publisher · View at Google Scholar · View at Scopus
  100. L. Schwabe, M. Tegenthoff, O. Höffken, and O. T. Wolf, “Simultaneous glucocorticoid and noradrenergic activity disrupts the neural basis of goal-directed action in the human brain,” The Journal of Neuroscience, vol. 32, no. 30, pp. 10146–10155, 2012. View at Publisher · View at Google Scholar · View at Scopus
  101. B. J. Everitt, R. N. Cardinal, J. A. Parkinson, and T. W. Robbins, “Appetitive behavior: impact of amygdala-dependent mechanisms of emotional learning,” Annals of the new York Academy of Sciences, vol. 985, pp. 233–250, 2003. View at Google Scholar
  102. K. M. Wassum and A. Izquierdo, “The basolateral amygdala in reward learning and addiction,” Neuroscience and Biobehavioral Reviews, vol. 57, pp. 271–283, 2015. View at Publisher · View at Google Scholar · View at Scopus
  103. C. Martin-Soelch, J. Linthicum, and M. Ernst, “Appetitive conditioning: neural bases and implications for psychopathology,” Neuroscience and Biobehavioral Reviews, vol. 31, no. 3, pp. 426–440, 2007. View at Publisher · View at Google Scholar · View at Scopus
  104. C. J. Peck and C. D. Salzman, “Amygdala neural activity reflects spatial attention towards stimuli promising reward or threatening punishment,” eLife, vol. 3, 2014. View at Publisher · View at Google Scholar · View at Scopus
  105. C. J. Peck and C. D. Salzman, “The amygdala and basal forebrain as a pathway for motivationally guided attention,” The Journal of Neuroscience, vol. 34, no. 41, pp. 13757–13767, 2014. View at Publisher · View at Google Scholar · View at Scopus
  106. J. P. O'Doherty, “Reward representations and reward-related learning in the human brain: insights from neuroimaging,” Current Opinion in Neurobiology, vol. 14, no. 6, pp. 769–776, 2004. View at Publisher · View at Google Scholar · View at Scopus
  107. S. A. Jackson, N. K. Horst, A. Pears, T. W. Robbins, and A. C. Roberts, “Role of the perigenual anterior cingulate and orbitofrontal cortex in contingency learning in the marmoset,” Cerebral Cortex, vol. 26, no. 7, pp. 3273–3284, 2016. View at Publisher · View at Google Scholar · View at Scopus
  108. R. N. Cardinal, J. A. Parkinson, H. D. Marbini et al., “Role of the anterior cingulate cortex in the control over behavior by Pavlovian conditioned stimuli in rats,” Behavioral Neuroscience, vol. 117, no. 3, pp. 566–587, 2003. View at Publisher · View at Google Scholar · View at Scopus
  109. C. F. Zink, G. Pagnoni, M. E. Martin-Skurski, J. C. Chappelow, and G. S. Berns, “Human striatal responses to monetary reward depend on saliency,” Neuron, vol. 42, no. 3, pp. 509–517, 2004. View at Google Scholar
  110. H. H. Yin and B. J. Knowlton, “The role of the basal ganglia in habit formation,” Nature Reviews. Neuroscience, vol. 7, no. 6, pp. 464–476, 2006. View at Publisher · View at Google Scholar · View at Scopus
  111. S. E. Hyman, R. C. Malenka, and E. J. Nestler, “Neural mechanisms of addiction: the role of reward-related learning and memory,” Annual Review of Neuroscience, vol. 29, pp. 565–598, 2006. View at Publisher · View at Google Scholar · View at Scopus
  112. K. C. Berridge and T. E. Robinson, “What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?” Brain Research. Brain Research Reviews, vol. 28, no. 3, pp. 309–369, 1998. View at Google Scholar
  113. B. B. Averbeck and V. D. Costa, “Motivational neural circuits underlying reinforcement learning,” Nature Neuroscience, vol. 20, no. 4, pp. 505–512, 2017. View at Publisher · View at Google Scholar
  114. A. Nahimi, S. Jakobsen, O. L. Munk et al., “Mapping alpha2 adrenoceptors of the human brain with 11C-yohimbine,” Journal of Nuclear Medicine, vol. 56, no. 3, pp. 392–398, 2015. View at Publisher · View at Google Scholar · View at Scopus
  115. K. H. E, S. H. Chen, M. H. Ho, and J. E. Desmond, “A meta-analysis of cerebellar contributions to higher cognition from PET and fMRI studies,” Human Brain Mapping, vol. 35, no. 2, pp. 593–615, 2014. View at Publisher · View at Google Scholar · View at Scopus
  116. S. J. Sara and M. Segal, “Plasticity of sensory responses of locus coeruleus neurons in the behaving rat: implications for cognition,” Progress in Brain Research, vol. 88, pp. 571–585, 1991. View at Google Scholar
  117. K. C. Berridge, “The debate over dopamine’s role in reward: the case for incentive salience,” Psychopharmacology, vol. 191, no. 3, pp. 391–431, 2007. View at Publisher · View at Google Scholar · View at Scopus
  118. S. B. Flagel, J. J. Clark, T. E. Robinson et al., “A selective role for dopamine in stimulus-reward learning,” Nature, vol. 469, no. 7328, pp. 53–57, 2011. View at Publisher · View at Google Scholar · View at Scopus
  119. M. Pessiglione, B. Seymour, G. Flandin, R. J. Dolan, and C. D. Frith, “Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans,” Nature, vol. 442, no. 7106, pp. 1042–1045, 2006. View at Publisher · View at Google Scholar · View at Scopus
  120. W. Schultz, “Getting formal with dopamine and reward,” Neuron, vol. 36, no. 2, pp. 241–263, 2002. View at Publisher · View at Google Scholar · View at Scopus
  121. D. Weinshenker and J. P. Schroeder, “There and back again: a tale of norepinephrine and drug addiction,” Neuropsychopharmacology, vol. 32, no. 7, pp. 1433–1451, 2007. View at Publisher · View at Google Scholar · View at Scopus
  122. M. R. Zarrindast, T. Bahreini, and M. Adl, “Effect of imipramine on the expression and acquisition of morphine-induced conditioned place preference in mice,” Pharmacology, Biochemistry, and Behavior, vol. 73, no. 4, pp. 941–949, 2002. View at Publisher · View at Google Scholar · View at Scopus
  123. C. Drouin, L. Darracq, F. Trovero et al., “Alpha1b-adrenergic receptors control locomotor and rewarding effects of psychostimulants and opiates,” The Journal of Neuroscience, vol. 22, no. 7, pp. 2873–2884, 2002. View at Publisher · View at Google Scholar
  124. R. Ventura, S. Cabib, A. Alcaro, C. Orsini, and S. Puglisi-Allegra, “Norepinephrine in the prefrontal cortex is critical for amphetamine-induced reward and mesoaccumbens dopamine release,” The Journal of Neuroscience, vol. 23, no. 5, pp. 1879–1885, 2003. View at Google Scholar
  125. R. Ventura, A. Alcaro, and S. Puglisi-Allegra, “Prefrontal cortical norepinephrine release is critical for morphine-induced reward, reinstatement and dopamine release in the nucleus accumbens,” Cerebral Cortex, vol. 15, no. 12, pp. 1877–1886, 2005. View at Publisher · View at Google Scholar · View at Scopus
  126. S. Bouret and B. J. Richmond, “Relation of locus coeruleus neurons in monkeys to Pavlovian and operant behaviors,” Journal of Neurophysiology, vol. 101, no. 2, pp. 898–911, 2009. View at Publisher · View at Google Scholar · View at Scopus
  127. S. Bouret, S. Ravel, and B. J. Richmond, “Complementary neural correlates of motivation in dopaminergic and noradrenergic neurons of monkeys,” Frontiers in Behavioral Neuroscience, vol. 6, p. 40, 2012. View at Publisher · View at Google Scholar · View at Scopus
  128. S. Bouret and B. J. Richmond, “Sensitivity of locus ceruleus neurons to reward value for goal-directed actions,” The Journal of Neuroscience, vol. 35, no. 9, pp. 4005–4014, 2015. View at Publisher · View at Google Scholar · View at Scopus
  129. M. R. Nassar, K. M. Rumsey, R. C. Wilson, K. Parikh, B. Heasly, and J. I. Gold, “Rational regulation of learning dynamics by pupil-linked arousal systems,” Nature Neuroscience, vol. 15, no. 7, pp. 1040–1046, 2012. View at Publisher · View at Google Scholar · View at Scopus
  130. E. Payzan-LeNestour, S. Dunne, P. Bossaerts, and J. P. O'Doherty, “The neural representation of unexpected uncertainty during value-based decision making,” Neuron, vol. 79, no. 1, pp. 191–201, 2013. View at Publisher · View at Google Scholar · View at Scopus
  131. B. F. Sadacca, A. M. Wikenheiser, and G. Schoenbaum, “Toward a theoretical role for tonic norepinephrine in the orbitofrontal cortex in facilitating flexible learning,” Neuroscience, vol. 345, pp. 124–129, 2017. View at Publisher · View at Google Scholar · View at Scopus
  132. M. Jepma and S. Nieuwenhuis, “Pupil diameter predicts changes in the exploration-exploitation trade-off: evidence for the adaptive gain theory,” Journal of Cognitive Neuroscience, vol. 23, no. 7, pp. 1587–1596, 2011. View at Publisher · View at Google Scholar · View at Scopus
  133. L. Schwabe and O. T. Wolf, “Stress-induced modulation of instrumental behavior: from goal-directed to habitual control of action,” Behavioural Brain Research, vol. 219, no. 2, pp. 321–328, 2011. View at Publisher · View at Google Scholar · View at Scopus
  134. L. Schwabe, O. Höffken, M. Tegenthoff, and O. T. Wolf, “Preventing the stress-induced shift from goal-directed to habit action with a beta-adrenergic antagonist,” The Journal of Neuroscience, vol. 31, no. 47, pp. 17317–17325, 2011. View at Publisher · View at Google Scholar · View at Scopus
  135. L. K. Graham, T. Yoon, and J. J. Kim, “Stress impairs optimal behavior in a water foraging choice task in rats,” Learning & Memory, vol. 17, no. 1, pp. 1–4, 2010. View at Publisher · View at Google Scholar · View at Scopus
  136. L. Schwabe and O. T. Wolf, “Stress prompts habit behavior in humans,” The Journal of Neuroscience, vol. 29, no. 22, pp. 7191–7198, 2009. View at Publisher · View at Google Scholar · View at Scopus
  137. P. V. Piazza and M. L. Moal, “The role of stress in drug self-administration,” Trends in Pharmacological Sciences, vol. 19, no. 2, pp. 67–74, 1998. View at Google Scholar
  138. R. Sinha, “Chronic stress, drug use, and vulnerability to addiction,” Annals of the new York Academy of Sciences, vol. 1141, pp. 105–130, 2008. View at Publisher · View at Google Scholar · View at Scopus
  139. E. Pool, T. Brosch, S. Delplanque, and D. Sander, “Stress increases cue-triggered “wanting” for sweet reward in humans,” Journal of Experimental Psychology: Animal Learning and Cognition, vol. 41, no. 2, pp. 128–136, 2015. View at Publisher · View at Google Scholar · View at Scopus
  140. G. Aston-Jones and P. W. Kalivas, “Brain norepinephrine rediscovered in addiction research,” Biological Psychiatry, vol. 63, no. 11, pp. 1005-1006, 2008. View at Publisher · View at Google Scholar · View at Scopus
  141. G. Hasler, W. C. Drevets, H. K. Manji, and D. S. Charney, “Discovering endophenotypes for major depression,” Neuropsychopharmacology, vol. 29, no. 10, pp. 1765–1781, 2004. View at Publisher · View at Google Scholar · View at Scopus
  142. K. L. Kasch, J. Rottenberg, B. A. Arnow, and I. H. Gotlib, “Behavioral activation and inhibition systems and the severity and course of depression,” Journal of Abnormal Psychology, vol. 111, no. 4, pp. 589–597, 2002. View at Publisher · View at Google Scholar
  143. C. E. Wang, T. Brennen, and A. Holte, “Decreased approach motivation in depression,” Scandinavian Journal of Psychology, vol. 47, no. 6, pp. 505–511, 2006. View at Publisher · View at Google Scholar · View at Scopus
  144. A. Must, Z. Szabó, N. Bódi, A. Szász, Z. Janka, and S. Kéri, “Sensitivity to reward and punishment and the prefrontal cortex in major depression,” Journal of Affective Disorders, vol. 90, no. 2-3, pp. 209–215, 2006. View at Publisher · View at Google Scholar · View at Scopus
  145. E. Vrieze, D. A. Pizzagalli, K. Demyttenaere et al., “Reduced reward learning predicts outcome in major depressive disorder,” Biological Psychiatry, vol. 73, no. 7, pp. 639–645, 2013. View at Publisher · View at Google Scholar · View at Scopus
  146. P. Kumar, G. Waiter, T. Ahearn, M. Milders, I. Reid, and J. D. Steele, “Abnormal temporal difference reward-learning signals in major depression,” Brain, vol. 131, Part 8, pp. 2084–2093, 2008. View at Publisher · View at Google Scholar · View at Scopus
  147. R. Bogdan, Y. S. Nikolova, and D. A. Pizzagalli, “Neurogenetics of depression: a focus on reward processing and stress sensitivity,” Neurobiology of Disease, vol. 52, pp. 12–23, 2013. View at Publisher · View at Google Scholar · View at Scopus
  148. Q. J. Huys, D. A. Pizzagalli, R. Bogdan, and P. Dayan, “Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis,” Biology of Mood & Anxiety Disorders, vol. 3, no. 1, p. 12, 2013. View at Publisher · View at Google Scholar
  149. A. M. Brailean, E. H. Koster, K. Hoorelbeke, and R. De Raedt, “Attentional modulation by reward and punishment cues in relation to depressive symptoms,” Journal of Behavior Therapy and Experimental Psychiatry, vol. 45, no. 3, pp. 351–359, 2014. View at Publisher · View at Google Scholar · View at Scopus
  150. D. A. Pizzagalli, D. Iosifescu, L. A. Hallett, K. G. Ratner, and M. Fava, “Reduced hedonic capacity in major depressive disorder: evidence from a probabilistic reward task,” Journal of Psychiatric Research, vol. 43, no. 1, pp. 76–87, 2008. View at Publisher · View at Google Scholar · View at Scopus
  151. L. H. Berghorst, R. Bogdan, M. J. Frank, and D. A. Pizzagalli, “Acute stress selectively reduces reward sensitivity,” Frontiers in Human Neuroscience, vol. 7, p. 133, 2013. View at Publisher · View at Google Scholar · View at Scopus
  152. R. Bogdan and D. A. Pizzagalli, “Acute stress reduces reward responsiveness: implications for depression,” Biological Psychiatry, vol. 60, no. 10, pp. 1147–1154, 2006. View at Publisher · View at Google Scholar · View at Scopus
  153. J. F. Cavanagh, M. J. Frank, and J. J. Allen, “Social stress reactivity alters reward and punishment learning,” Social Cognitive and Affective Neuroscience, vol. 6, no. 3, pp. 311–320, 2011. View at Publisher · View at Google Scholar · View at Scopus
  154. M. Joels, Z. Pu, O. Wiegert, M. S. Oitzl, and H. J. Krugers, “Learning under stress: how does it work?” Trends in Cognitive Sciences, vol. 10, no. 4, pp. 152–158, 2006. View at Publisher · View at Google Scholar · View at Scopus
  155. J. C. Woodson, D. Macintosh, M. Fleshner, and D. M. Diamond, “Emotion-induced amnesia in rats: working memory-specific impairment, corticosterone-memory correlation, and fear versus arousal effects on memory,” Learning & Memory, vol. 10, no. 5, pp. 326–336, 2003. View at Publisher · View at Google Scholar · View at Scopus
  156. R. M. Yerkes and J. D. Dodson, “The relation of strength of stimulus to rapidity of habit-formation,” Journal of Comparative Neurology and Psychology, vol. 18, pp. 459–482, 1908. View at Google Scholar
  157. D. M. Diamond, “Cognitive, endocrine and mechanistic perspectives on non-linear relationships between arousal and brain function,” Nonlinearity in Biology Toxicology and Medicine, vol. 3, no. 1, pp. 1–7, 2005. View at Publisher · View at Google Scholar