Table of Contents Author Guidelines Submit a Manuscript
Complexity
Volume 2017, Article ID 7046359, 14 pages
https://doi.org/10.1155/2017/7046359
Research Article

Information Integration from Distributed Threshold-Based Interactions

Programa de Engenharia de Sistemas e Computação, COPPE, Universidade Federal do Rio de Janeiro, Caixa Postal 68511, 21941-972 Rio de Janeiro, RJ, Brazil

Correspondence should be addressed to Valmir C. Barbosa; rb.jrfu.soc@rimlav

Received 7 July 2016; Accepted 28 September 2016; Published 11 January 2017

Academic Editor: Dimitri Volchenkov

Copyright © 2017 Valmir C. Barbosa. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. M. F. Bear, B. W. Connors, and M. A. Paradiso, Neuroscience, Wolters Kluwer, Philadelphia, Pa, USA, 4th edition, 2015.
  2. W. S. McCulloch and W. Pitts, “A logical calculus of the ideas immanent in nervous activity,” Bulletin of Mathematical Biophysics, vol. 5, pp. 115–133, 1943. View at Google Scholar
  3. A. Pistorello, C. Romoli, and S. Crespi-Reghizzi, “Threshold nets and cell-assemblies,” Information and Control, vol. 49, no. 3, pp. 239–264, 1981. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
  4. A. Ilachinski, Cellular Automata, World Scientific, Singapore, 2001. View at Publisher · View at Google Scholar · View at MathSciNet
  5. J. J. Hopfield, “Neural networks and physical systems with emergent collective computational abilities,” Proceedings of the National Academy of Sciences of the United States of America, vol. 79, no. 8, pp. 2554–2558, 1982. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  6. J. J. Hopfield, “Neurons with graded response have collective computational properties like those of two-state neurons,” Proceedings of the National Academy of Sciences of the United States of America, vol. 81, no. 10, pp. 3088–3092, 1984. View at Publisher · View at Google Scholar · View at Scopus
  7. D. H. Ackley, G. E. Hinton, and T. J. Sejnowski, “A learning algorithm for Boltzmann machines,” Cognitive Science, vol. 9, no. 1, pp. 147–169, 1985. View at Publisher · View at Google Scholar · View at Scopus
  8. J. Pearl, Probabilistic Reasoning in Intelligent Systems, Morgan Kaufmann, San Mateo, Calif, USA, 1988. View at MathSciNet
  9. T. Hrycej, “Gibbs sampling in Bayesian networks,” Artificial Intelligence, vol. 46, no. 3, pp. 351–363, 1990. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  10. R. Kinderman and J. L. Snell, Markov Random Fields and Their Applications, American Mathematical Society, Providence, RI, USA, 1980.
  11. S. Geman and D. Geman, “Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 6, no. 6, pp. 721–741, 1984. View at Google Scholar · View at Scopus
  12. V. C. Barbosa, Massively Parallel Models of Computation, Ellis Horwood, Chichester, UK, 1993.
  13. D. Koller and N. Friedman, Probabilistic Graphical Models, The MIT Press, Cambridge, Mass, USA, 2009. View at MathSciNet
  14. P. Smolensky, “Information processing in dynamical systems: foundations of harmony theory,” in Parallel Distributed Processing, D. E. Rumelhart, J. L. McClelland, and PDP Research Group, Eds., vol. 1, pp. 194–281, The MIT Press, Cambridge, Mass, USA, 1986. View at Google Scholar
  15. A. Fischer and C. Igel, “Training restricted Boltzmann machines: an introduction,” Pattern Recognition, vol. 47, no. 1, pp. 25–39, 2014. View at Publisher · View at Google Scholar · View at Scopus
  16. G. Hinton, “Deep belief networks,” Scholarpedia, vol. 4, no. 5, p. 5947, 2009. View at Publisher · View at Google Scholar
  17. V. Mnih, K. Kavukcuoglu, D. Silver et al., “Human-level control through deep reinforcement learning,” Nature, vol. 518, no. 7540, pp. 529–533, 2015. View at Publisher · View at Google Scholar · View at Scopus
  18. Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, 2015. View at Publisher · View at Google Scholar · View at Scopus
  19. D. Silver, A. Huang, C. J. Maddison et al., “Mastering the game of Go with deep neural networks and tree search,” Nature, vol. 529, no. 7587, pp. 484–489, 2016. View at Publisher · View at Google Scholar
  20. A. Nathan and V. C. Barbosa, “Network algorithmics and the emergence of information integration in cortical models,” Physical Review E, vol. 84, no. 1, Article ID 011904, 2011. View at Publisher · View at Google Scholar · View at Scopus
  21. K. K. Cassiano and V. C. Barbosa, “Information integration in elementary cellular automata,” Journal of Cellular Automata, vol. 10, no. 3-4, pp. 235–260, 2015. View at Google Scholar · View at MathSciNet · View at Scopus
  22. S. Watanabe, “Information theoretical analysis of multivariate correlation,” IBM Journal of Research and Development, vol. 4, no. 1, pp. 66–82, 1960. View at Publisher · View at Google Scholar · View at MathSciNet
  23. D. W. Zhou, D. D. Mowrey, P. Tang, and Y. Xu, “Percolation model of sensory transmission and loss of consciousness under general anesthesia,” Physical Review Letters, vol. 115, no. 10, Article ID 108103, 2015. View at Publisher · View at Google Scholar · View at Scopus
  24. D. Balduzzi and G. Tononi, “Integrated information in discrete dynamical systems: motivation and theoretical framework,” PLoS Computational Biology, vol. 4, no. 6, Article ID e1000091, 2008. View at Publisher · View at Google Scholar · View at Scopus
  25. J. N. D. Kerr, D. Greenberg, and F. Helmchen, “Imaging input and output of neocortical networks in vivo,” Proceedings of the National Academy of Sciences of the United States of America, vol. 102, no. 39, pp. 14063–14068, 2005. View at Publisher · View at Google Scholar · View at Scopus
  26. S. Shoham, D. H. O'Connor, and R. Segev, “How silent is the brain: is there a ‘dark matter’ problem in neuroscience?” Journal of Comparative Physiology A, vol. 192, no. 8, pp. 777–784, 2006. View at Publisher · View at Google Scholar · View at Scopus
  27. A. M. Mathai, P. Moschopoulos, and G. Pederzoli, “Random points associated with rectangles,” Rendiconti del Circolo Matematico di Palermo, vol. 48, no. 1, pp. 163–190, 1999. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  28. D. P. Robbins and T. S. Bolis, “Average distance between two points in a box,” The American Mathematical Monthly, vol. 85, no. 4, pp. 277–278, 1978. View at Publisher · View at Google Scholar
  29. A. Žilinskas, “On the distribution of the distance between two points in a cube,” Random Operators and Stochastic Equations, vol. 11, no. 1, pp. 21–24, 2003. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  30. W. Feller, An Introduction to Probability Theory and Its Applications, vol. 1, John Wiley & Sons, New York, NY, USA, 3rd edition, 1968.
  31. M. Penrose, Random Geometric Graphs, Oxford University Press, Oxford, UK, 2003. View at Publisher · View at Google Scholar · View at MathSciNet
  32. P. Erdős and A. Rényi, “On random graphs,” Publicationes Mathematicae (Debrecen), vol. 6, pp. 290–297, 1959. View at Google Scholar
  33. R. M. Karp, “The transitive closure of a random digraph,” Random Structures & Algorithms, vol. 1, no. 1, pp. 73–93, 1990. View at Publisher · View at Google Scholar · View at MathSciNet
  34. T. S. Han, “Multiple mutual informations and multiple interactions in frequency data,” Information and Control, vol. 46, no. 1, pp. 26–45, 1980. View at Publisher · View at Google Scholar · View at MathSciNet
  35. L. L. Campbell, “Averaging entropy,” IEEE Transactions on Information Theory, vol. 41, no. 1, pp. 338–339, 1995. View at Publisher · View at Google Scholar · View at Scopus
  36. J. M. L. Budd and Z. F. Kisvárday, “Communication and wiring in the cortical connectome,” Frontiers in Neuroanatomy, vol. 6, article 42, 2012. View at Publisher · View at Google Scholar
  37. W.-C. A. Lee, V. Bonin, M. Reed et al., “Anatomy and function of an excitatory network in the visual cortex,” Nature, vol. 532, no. 7599, pp. 370–374, 2016. View at Publisher · View at Google Scholar
  38. B. Rudy, G. Fishell, S. Lee, and J. Hjerling-Leffler, “Three groups of interneurons account for nearly 100% of neocortical GABAergic neurons,” Developmental Neurobiology, vol. 71, no. 1, pp. 45–61, 2011. View at Publisher · View at Google Scholar · View at Scopus
  39. M. Steriade, I. Timofeev, and F. Grenier, “Natural waking and sleep states: a view from inside neocortical neurons,” Journal of Neurophysiology, vol. 85, no. 5, pp. 1969–1985, 2001. View at Google Scholar · View at Scopus
  40. A. Hasenstaub, Y. Shu, B. Haider, U. Kraushaar, A. Duque, and D. A. McCormick, “Inhibitory postsynaptic potentials carry synchronized frequency information in active cortical networks,” Neuron, vol. 47, no. 3, pp. 423–435, 2005. View at Publisher · View at Google Scholar · View at Scopus
  41. Y. Shu, A. Hasenstaub, A. Duque, Y. Yu, and D. A. McCormick, “Modulation of intracortical synaptic potentials by presynaptic somatic membrane potential,” Nature, vol. 441, no. 7094, pp. 761–765, 2006. View at Publisher · View at Google Scholar · View at Scopus
  42. M. Shimono and J. M. Beggs, “Functional clusters, hubs, and communities in the cortical microconnectome,” Cerebral Cortex, vol. 25, no. 10, pp. 3743–3757, 2015. View at Publisher · View at Google Scholar · View at Scopus
  43. S. Herculano-Houzel, “The human brain in numbers: a linearly scaled-up primate brain,” Frontiers in Human Neuroscience, vol. 3, article 31, 2009. View at Publisher · View at Google Scholar · View at Scopus
  44. C. E. Collins, D. C. Airey, N. A. Young, D. B. Leitch, and J. H. Kaas, “Neuron densities vary across and within cortical areas in primates,” Proceedings of the National Academy of Sciences of the United States of America, vol. 107, no. 36, pp. 15927–15932, 2010. View at Publisher · View at Google Scholar · View at Scopus
  45. A. Luczak, P. Bartho, and K. D. Harris, “Gating of sensory input by spontaneous cortical activity,” Journal of Neuroscience, vol. 33, no. 4, pp. 1684–1695, 2013. View at Publisher · View at Google Scholar · View at Scopus
  46. R. Milo, P. Jorgensen, U. Moran, G. Weber, and M. Springer, “BioNumbers—the database of key numbers in molecular and cell biology,” Nucleic Acids Research, vol. 38, no. 1, Article ID gkp889, pp. D750–D753, 2010. View at Publisher · View at Google Scholar · View at Scopus
  47. H. A. Swadlow and S. G. Waxman, “Axonal conduction delays,” Scholarpedia, vol. 7, p. 1451, 2012. View at Publisher · View at Google Scholar
  48. M. H. Herzog, T. Kammer, and F. Scharnowski, “Time slices: what is the duration of a percept?” PLoS Biology, vol. 14, no. 4, Article ID e1002433, 2016. View at Publisher · View at Google Scholar
  49. M. Oizumi, L. Albantakis, and G. Tononi, “From the phenomenology to the mechanisms of consciousness: integrated information theory 3.0,” PLoS Computational Biology, vol. 10, no. 5, Article ID e1003588, 2014. View at Publisher · View at Google Scholar · View at Scopus
  50. K. P. O'Keeffe, P. L. Krapivsky, and S. H. Strogatz, “Synchronization as aggregation: cluster kinetics of pulse-coupled oscillators,” Physical Review Letters, vol. 115, no. 6, Article ID 064101, 2015. View at Publisher · View at Google Scholar · View at Scopus