Table of Contents Author Guidelines Submit a Manuscript
Computational Intelligence and Neuroscience
Volume 2014, Article ID 383790, 12 pages
http://dx.doi.org/10.1155/2014/383790
Research Article

A Two-Layered Diffusion Model Traces the Dynamics of Information Processing in the Valuation-and-Choice Circuit of Decision Making

1Department of Medicine, Surgery & Neurosciences, University of Siena, Viale Bracci 2, 53100 Siena, Italy
2Eye-Tracking & Visual Application Lab, University of Siena, Viale Bracci 2, 53100 Siena, Italy
3Department of Social, Political and Cognitive Sciences, University of Siena, Via Roma 56, 53100 Siena, Italy

Received 29 October 2013; Revised 18 July 2014; Accepted 7 August 2014; Published 31 August 2014

Academic Editor: Pablo Varona

Copyright © 2014 Pietro Piu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. J. D. Schall, “Neural basis of deciding, choosing and acting,” Nature Reviews Neuroscience, vol. 2, no. 1, pp. 33–42, 2001. View at Publisher · View at Google Scholar · View at Scopus
  2. M. N. Shadlen and W. T. Newsome, “Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey,” Journal of Neurophysiology, vol. 86, no. 4, pp. 1916–1936, 2001. View at Google Scholar · View at Scopus
  3. K. F. Wong, A. C. Huk, M. N. Shadlen, and X. J. Wang, “Neural circuit dynamics underlying accumulation of time-varying evidence during perceptual decision making,” Frontiers in Computational Neuroscience, vol. 1, no. 6, pp. 1–11, 2007. View at Google Scholar
  4. P. L. Smith and R. Ratcliff, “Psychology and neurobiology of simple decisions,” Trends in Neurosciences, vol. 27, no. 3, pp. 161–168, 2004. View at Publisher · View at Google Scholar · View at Scopus
  5. R. Ratcliff, “A theory of memory retrieval,” Psychological Review, vol. 85, no. 2, pp. 59–108, 1978. View at Publisher · View at Google Scholar · View at Scopus
  6. M. Usher and J. L. McClelland, “The time course of perceptual choice: the leaky, competing accumulator model,” Psychological Review, vol. 108, no. 3, pp. 550–592, 2001. View at Publisher · View at Google Scholar · View at Scopus
  7. J. I. Gold and M. N. Shadlen, “Banburismus and the brain: Decoding the relationship between sensory stimuli, decisions, and reward,” Neuron, vol. 36, no. 2, pp. 299–308, 2002. View at Publisher · View at Google Scholar · View at Scopus
  8. D. P. Hanes and J. D. Schall, “Neural control of voluntary movement initiation,” Science, vol. 274, no. 5286, pp. 427–430, 1996. View at Publisher · View at Google Scholar · View at Scopus
  9. R. Ratcliff, “The role of mathematical psychology in experimental psychology,” The Australian Journal of Psychology, vol. 50, pp. 129–130, 1998. View at Google Scholar
  10. R. Ratcliff and F. Tuerlinckx, “Estimating parameters of the diffusion model: approaches to dealing with contaminant reaction times and parameter variability,” Psychonomic Bulletin and Review, vol. 9, no. 3, pp. 438–481, 2002. View at Publisher · View at Google Scholar · View at Scopus
  11. R. Ratcliff, A. Cherian, and M. Segraves, “A comparison of Macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions,” Journal of Neurophysiology, vol. 90, no. 3, pp. 1392–1407, 2003. View at Publisher · View at Google Scholar · View at Scopus
  12. M. N. Shadlen, T. D. Hanks, A. K. Churchland, R. Kiani, and T. Yang, “The speed and accuracy of a simple perceptual decision: a mathematical primer,” in Bayesian Brain: Probabilistic Approaches to Neural Coding, K. Doya, S. Ishii, A. Pouget, and R. P. N. Rao, Eds., The MIT Press, Cambridge, Mass, USA, 2007. View at Google Scholar
  13. W. T. Newsome, K. H. Britten, and J. A. Movshon, “Neuronal correlates of a perceptual decision,” Nature, vol. 341, no. 6237, pp. 52–54, 1989. View at Publisher · View at Google Scholar · View at Scopus
  14. M. N. Shadlen and W. T. Newsome, “Motion perception: Seeing and deciding,” Proceedings of the National Academy of Sciences of the United States of America, vol. 93, no. 2, pp. 628–633, 1996. View at Publisher · View at Google Scholar · View at Scopus
  15. J. D. Roitman and M. N. Shadlen, “Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task,” Journal of Neuroscience, vol. 22, no. 21, pp. 9475–9489, 2002. View at Google Scholar · View at Scopus
  16. X. Wang, “Probabilistic decision making by slow reverberation in cortical circuits,” Neuron, vol. 36, no. 5, pp. 955–968, 2002. View at Publisher · View at Google Scholar · View at Scopus
  17. H. Seo, D. J. Barraclough, and D. Lee, “Lateral intraparietal cortex and reinforcement learning during a mixed-strategy game,” Journal of Neuroscience, vol. 29, no. 22, pp. 7278–7279, 2009. View at Publisher · View at Google Scholar · View at Scopus
  18. J.-N. Kim and M. N. Shadlen, “Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque,” Nature Neuroscience, vol. 2, no. 2, pp. 176–185, 1999. View at Publisher · View at Google Scholar · View at Scopus
  19. A. J. Parker and K. Krug, “Neuronal mechanisms for the perception of ambiguous stimuli,” Current Opinion in Neurobiology, vol. 13, no. 4, pp. 433–439, 2003. View at Publisher · View at Google Scholar · View at Scopus
  20. C. Law and J. I. Gold, “Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area,” Nature Neuroscience, vol. 11, no. 4, pp. 505–513, 2008. View at Publisher · View at Google Scholar · View at Scopus
  21. P. Redgrave, T. J. Prescott, and K. Gurney, “The basal ganglia: a vertebrate solution to the selection problem?” Neuroscience, vol. 89, no. 4, pp. 1009–1023, 1999. View at Publisher · View at Google Scholar · View at Scopus
  22. R. Bogacz and K. Gurney, “The basal ganglia and cortex implement optimal decision making between alternative actions,” Neural Computation, vol. 19, no. 2, pp. 442–477, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
  23. G. Chevalier, S. Vacher, J. M. Deniau, and M. Desban, “Disinhibition as a basic process in the expression of striatal functions. I. The striato-nigral influence on tecto-spinal/tecto-diencephalic neurons,” Brain Research, vol. 334, no. 2, pp. 215–226, 1985. View at Publisher · View at Google Scholar · View at Scopus
  24. J. M. Deniau and G. Chevalier, “Disinhibition as a basic process in the expression of striatal functions. II. The striato-nigral influence on thalamocortical cells of the ventromedial thalamic nucleus,” Brain Research, vol. 334, no. 2, pp. 227–233, 1985. View at Publisher · View at Google Scholar · View at Scopus
  25. A. Parent and L. N. Hazrati, “Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop,” Brain Research Reviews, vol. 20, no. 1, pp. 91–127, 1995. View at Publisher · View at Google Scholar · View at Scopus
  26. M. C. Keuken, C. Müller-Axt, R. Langner, S. B. Eickhoff, B. U. Forstmann, and J. Neumann, “Brain networks of perceptual decision-making: an fMRI ALE meta-analysis,” Frontiers in Human Neuroscience, vol. 8, article 445, 2014. View at Publisher · View at Google Scholar
  27. C. Lo and X. Wang, “Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks,” Nature Neuroscience, vol. 9, no. 7, pp. 956–963, 2006. View at Publisher · View at Google Scholar · View at Scopus
  28. J. W. Kable and P. W. Glimcher, “The neurobiology of decision: consensus and controversy,” Neuron, vol. 63, no. 6, pp. 733–745, 2009. View at Publisher · View at Google Scholar · View at Scopus
  29. R. Bogacz, E. Brown, J. Moehlis, P. Holmes, and J. D. Cohen, “The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced-choice tasks,” Psychological Review, vol. 113, no. 4, pp. 700–765, 2006. View at Publisher · View at Google Scholar · View at Scopus
  30. P. L. Smith, “Stochastic dynamic models of response time and accuracy: a foundational primer,” Journal of Mathematical Psychology, vol. 44, no. 3, pp. 408–463, 2000. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  31. D. R. J. Laming, Information Theory of Choice-reaction Times, John Wiley & Sons, New York, NY, USA, 1968.
  32. W. A. Wickelgren, “Speed-accuracy tradeoff and information processing dynamics,” Acta Psychologica, vol. 41, no. 1, pp. 67–85, 1977. View at Publisher · View at Google Scholar · View at Scopus
  33. G. Deco, E. T. Rolls, and R. Romo, “Stochastic dynamics as a principle of brain function,” Progress in Neurobiology, vol. 88, no. 1, pp. 1–16, 2009. View at Publisher · View at Google Scholar · View at Scopus
  34. R. Ratcliff and P. L. Smith, “A comparison of sequential sampling models for two-choice reaction time,” Psychological Review, vol. 111, no. 2, pp. 333–367, 2004. View at Publisher · View at Google Scholar · View at Scopus
  35. S. W. Link, “The relative judgment theory of two choice response time,” Journal of Mathematical Psychology, vol. 12, no. 1, pp. 114–135, 1975. View at Publisher · View at Google Scholar · View at Scopus
  36. H. Pashler, “Processing stages in overlapping tasks: evidence for a central bottleneck,” Journal of Experimental Psychology: Human Perception and Performance, vol. 10, no. 3, pp. 358–377, 1984. View at Publisher · View at Google Scholar · View at Scopus
  37. J. E. Raymond, K. L. Shapiro, and K. M. Arnell, “Temporary Suppression of Visual Processing in an RSVP Task: an Attentional Blink?” Journal of Experimental Psychology: Human Perception and Performance, vol. 18, no. 3, pp. 849–860, 1992. View at Publisher · View at Google Scholar · View at Scopus
  38. V. Wyart, V. de Gardelle, J. Scholl, and C. Summerfield, “Rhythmic fluctuations in evidence accumulation during decision making in the human brain,” Neuron, vol. 76, no. 4, pp. 847–858, 2012. View at Publisher · View at Google Scholar · View at Scopus
  39. P. Lakatos, G. Karmos, A. D. Mehta, I. Ulbert, and C. E. Schroeder, “Entrainment of neuronal oscillations as a mechanism of attentional selection,” Science, vol. 320, no. 5872, pp. 110–113, 2008. View at Publisher · View at Google Scholar · View at Scopus
  40. C. E. Schroeder and P. Lakatos, “Low-frequency neuronal oscillations as instruments of sensory selection,” Trends in Neurosciences, vol. 32, no. 1, pp. 9–18, 2009. View at Publisher · View at Google Scholar · View at Scopus
  41. S. Ostojic and N. Brunel, “From spiking neuron models to linear-nonlinear models,” PLoS Computational Biology, vol. 7, no. 1, Article ID e1001056, 2011. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  42. K. J. Friston, “Volterra kernels and connectivity,” in Human Brain Function, R. J. S. Franckowiak, C. Frith, R. Dolan et al., Eds., Academic Press, 2nd edition, 2003. View at Google Scholar
  43. K. J. Friston and C. Büchel, “Attentional modulation of effective connectivity from V2 to V5 in humans,” Proceedings of the National Academy of Sciences of the United States of America, vol. 97, pp. 7591–7596, 2000. View at Google Scholar
  44. K. J. Friston, “Brain function, nonlinear coupling, and neuronal transients,” The Neuroscientist, vol. 7, no. 5, pp. 406–418, 2001. View at Publisher · View at Google Scholar · View at Scopus
  45. P. Cisek and J. F. Kalaska, “Neural mechanisms for interacting with a world full of action choices,” Annual Review of Neuroscience, vol. 33, pp. 269–298, 2010. View at Publisher · View at Google Scholar · View at Scopus
  46. J. Rüter, N. Marcille, H. Sprekeler, W. Gerstner, and M. H. Herzog, “Paradoxical evidence integration in rapid decision processes,” PLoS Computational Biology, vol. 8, no. 2, Article ID e1002382, 2012. View at Publisher · View at Google Scholar · View at Scopus
  47. B. A. J. Reddi, “Decision making: the two stages of neuronal judgement,” Current Biology, vol. 11, no. 15, pp. R603–R606, 2001. View at Publisher · View at Google Scholar · View at Scopus
  48. E. T. Rolls, Emotions and Decision-Making Explained, Oxford University Press, 2014.
  49. G. Deco, E. T. Rolls, L. Albantakis, and R. Romo, “Brain mechanisms for perceptual and reward-related decision-making,” Progress in Neurobiology, vol. 103, pp. 194–213, 2013. View at Publisher · View at Google Scholar · View at Scopus
  50. A. Insabato, M. Pannunzi, E. T. Rolls, and G. Deco, “Confidence-related decision making,” Journal of Neurophysiology, vol. 104, no. 1, pp. 539–547, 2010. View at Publisher · View at Google Scholar · View at Scopus
  51. J. N. J. Reynolds and J. R. Wickens, “Dopamine-dependent plasticity of corticostriatal synapses,” Neural Networks, vol. 15, no. 4–6, pp. 507–521, 2002. View at Publisher · View at Google Scholar · View at Scopus
  52. X. J. Wang, “Neuronal circuit computation of choice,” in Neuroeconomics: Decision Making and the Brain, P. W. Glimcher, E. Fehr, C. Camerer, and R. A. Poldrack, Eds., Academic Press, 2008. View at Google Scholar
  53. X.-J. Wang, “Decision making in recurrent neuronal circuits,” Neuron, vol. 60, no. 2, pp. 215–234, 2008. View at Publisher · View at Google Scholar · View at Scopus
  54. E. M. Izhikevich, Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting, The MIT Press, Cambridge, Mass, USA, 2007. View at MathSciNet
  55. T. D. Sanger, “Neural population codes,” Current Opinion in Neurobiology, vol. 13, no. 2, pp. 238–249, 2003. View at Publisher · View at Google Scholar · View at Scopus
  56. W. J. Ma, J. M. Beck, P. E. Latham, and A. Pouget, “Bayesian inference with probabilistic population codes,” Nature Neuroscience, vol. 9, no. 11, pp. 1432–1438, 2006. View at Publisher · View at Google Scholar · View at Scopus
  57. T. P. Trappenberg, Fundamentals of Computational Neuroscience, Oxford University Press, New York, NY, USA, 2010. View at MathSciNet
  58. D. R. Cox, Renewal Process, Methuen, London, UK, 1962.
  59. H. C. Tuckwell, Introduction to Theoretical Neurobiology, vol. 2, Cambridge University Press, Cambridge, UK, 1988. View at MathSciNet
  60. F. Rieke, D. Warland, R. de Ruyter van Steveninck, and W. Bialek, Spikes: Exploring the Neural Code, Cambridge, Mass, USA, MIT Press, 1999. View at MathSciNet
  61. P. Dayan and L. F. Abbott, Theoretical Neuroscience: Computational and Mathematical Modelling of Neural Systems, The MIT Press, Boston, Mass, USA, 2001. View at MathSciNet
  62. M. T. Giraudo, R. M. Mininni, and L. Sacerdote, “On the asymptotic behavior of the parameter estimators for some diffusion processes: application to neuronal models,” Ricerche di Matematica, vol. 58, no. 1, pp. 103–127, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
  63. P. Lánsky, C. E. Smith, and L. M. Ricciardi, “One-dimensional stochastic diffusion models of neuronal activity and related first passage time problems,” in Trends in Biological Cybernetics, J. Menon, Ed., vol. 1, pp. 153–162, 1990. View at Google Scholar
  64. L. Sacerdote and C. Zucca, “Inverse first passage time method in the analysis of neuronal interspike intervals of neurons characterized by time varying dynamics,” in Proceedings of the 1st International Symposium on Brain, Vision and Artificial Intelligence (BVAI '05), Naples, Italy, 2005.
  65. W. Schwarz, “The ex-Wald distribution as a descriptive model of response times,” Behavior Research Methods, Instruments, and Computers, vol. 33, no. 4, pp. 457–469, 2001. View at Publisher · View at Google Scholar · View at Scopus
  66. R. Linsker, “A local learning rule that enables information maximization for arbitrary input distributions,” Neural Computation, vol. 9, no. 8, pp. 1661–1665, 1997. View at Publisher · View at Google Scholar · View at Scopus
  67. F. Gabbiani and S. J. Cox, Mathematics for Neuroscientists, Academic Press, New York, NY, USA, 2010.
  68. T. Schreiber and A. Schmitz, “Improved surrogate data for nonlinearity tests,” Physical Review Letters, vol. 77, no. 4, pp. 635–638, 1996. View at Publisher · View at Google Scholar
  69. M. G. Rosemblum and J. Kurths, “Analyzing synchronization phenomena from bivariate data by means of the Hilbert transform,” in Nonlinear Analysis of Physiological Data, pp. 91–99, Springer, 1998. View at Google Scholar
  70. J. C. Principe, Information Theoretic Learning: Renyi’s Entropy and Kernel Perspectives, Springer, 2010. View at Publisher · View at Google Scholar · View at MathSciNet
  71. D. P. Mandic, M. Chen, T. Gautama, M. M. van Hulle, and A. Constantinides, “On the characterization of the deterministic/stochastic and linear/nonlinear nature of time series,” Proceedings of The Royal Society of London A: Mathematical, Physical and Engineering Sciences, vol. 464, no. 2093, pp. 1141–1160, 2008. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  72. M. Colombo and P. Seriés, “Bayes in the brain: on Bayesian modelling in neuroscience,” British Journal for the Philosophy of Science, 2012. View at Publisher · View at Google Scholar
  73. M. Kawato, “Internal models for motor control and trajectory planning,” Current Opinion in Neurobiology, vol. 9, no. 6, pp. 718–727, 1999. View at Publisher · View at Google Scholar · View at Scopus
  74. P. Yin, “Maximum entropy-based optimal threshold selection using deterministic reinforcement learning with controlled randomization,” Signal Processing, vol. 82, no. 7, pp. 993–1006, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  75. J. N. Kapur, P. K. Sahoo, and A. K. C. Wong, “A new method for gray-level picture thresholding using the entropy of the histogram.,” Computer Vision, Graphics, & Image Processing, vol. 29, no. 3, pp. 273–285, 1985. View at Publisher · View at Google Scholar · View at Scopus
  76. S. Ostojic and N. Brunel, “From spiking neuron models to linear-nonlinear models,” PLoS Computational Biology, vol. 7, no. 1, Article ID e1001056, 16 pages, 2011. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  77. M. Siegel, A. K. Engel, and T. H. Donner, “Cortical network dynamics of perceptual decision-making in the human brain,” Frontiers in Human Neuroscience, vol. 5, article 21, 2011. View at Publisher · View at Google Scholar
  78. X. J. Wang, “Neural oscillations,” in Encyclopedia of Cognitive Science, L. Nabel, Ed., pp. 272–280, MacMillan, London, UK, 2003. View at Google Scholar
  79. M. Siegel and T. H. Donner, “Linking band-limited cortical population activity to fMRI and behavior,” in Integrating EEG and fMRI: Recording, Analysis, and Application, M. Ullsperger and S. Debener, Eds., pp. 271–294, University Press, New York, NY, USA, 2010. View at Google Scholar
  80. P. Fries, T. Womelsdorf, R. Oostenveld, and R. Desimone, “The effects of visual stimulation and selective visual attention on rhythmic neuronal synchronization in macaque area V4,” The Journal of Neuroscience, vol. 28, no. 18, pp. 4823–4835, 2008. View at Publisher · View at Google Scholar · View at Scopus
  81. V. Nácher, A. Ledberg, G. Deco, and R. Romo, “Coherent delta-band oscillations between cortical areas correlate with decision making,” Proceedings of the National Academy of Sciences of the United States of America, vol. 110, no. 37, pp. 15085–15090, 2013. View at Publisher · View at Google Scholar
  82. M. A. Beulen, The role of theta oscillations in memory and decision making, [Master thesis], University of Utrecht, Utrecht, The Netherlands, 2011.
  83. P. B. Sederberg, M. J. Kahana, M. W. Howard, E. J. Donner, and J. R. Madsen, “Theta and gamma oscillations during encoding predict subsequent recall,” Journal of Neuroscience, vol. 23, no. 34, pp. 10809–10814, 2003. View at Google Scholar · View at Scopus
  84. J. P. Bolan, A. Cali, and P. J. Magill, The Basal Ganglia VIII, Springer, New York, NY, USA, 2006.
  85. M. X. Cohen, C. E. Elger, and J. Fell, “Oscillatory activity and phase-amplitude coupling in the human medial frontal cortex during decision making,” Journal of Cognitive Neuroscience, vol. 21, no. 2, pp. 390–402, 2009. View at Publisher · View at Google Scholar · View at Scopus
  86. A. K. Engel and P. Fries, “Beta-band oscillations-signalling the status quo?” Current Opinion in Neurobiology, vol. 20, no. 2, pp. 156–165, 2010. View at Publisher · View at Google Scholar · View at Scopus
  87. R. C. DeCharms and A. Zador, “Neural representation and the cortical code,” Annual Review of Neuroscience, vol. 23, pp. 613–647, 2000. View at Publisher · View at Google Scholar · View at Scopus
  88. A. Voss, K. Rothermund, and J. Voss, “Interpreting the parameters of the diffusion model: an empirical validation,” Memory and Cognition, vol. 32, no. 7, pp. 1206–1220, 2004. View at Publisher · View at Google Scholar · View at Scopus
  89. E. Bertin, “Global fluctuations and Gumbel statistics,” Physical Review Letters, vol. 95, Article ID 170601, pp. 1–4, 2005. View at Publisher · View at Google Scholar
  90. E. Bertin and M. Clusel, “Generalized extreme value statistics and sum of correlated variables,” Journal of Physics A: Mathematical and General, vol. 39, no. 24, article 001, pp. 7607–7619, 2006. View at Publisher · View at Google Scholar · View at Scopus