Table of Contents Author Guidelines Submit a Manuscript
Computational Intelligence and Neuroscience
Volume 2015, Article ID 947098, 14 pages
http://dx.doi.org/10.1155/2015/947098
Research Article

Training Spiking Neural Models Using Artificial Bee Colony

1Intelligent Systems Group, Faculty of Engineering, La Salle University, Benjamín Franklin 47, Colonia Condesa, 06140 Mexico City, DF, Mexico
2Instituto en Investigaciones en Matemáticas Aplicadas y en Sistemas, Universidad Nacional Autónoma de México, Ciudad Universitaria, 04510 Mexico City, DF, Mexico

Received 18 October 2014; Accepted 6 January 2015

Academic Editor: Jianwei Shuai

Copyright © 2015 Roberto A. Vazquez and Beatriz A. Garro. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. B. A. Garro, H. Sossa, and R. A. Vazquez, “Design of artificial neural networks using a modified particle swarm optimization algorithm,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN '09), pp. 938–945, June 2009. View at Publisher · View at Google Scholar · View at Scopus
  2. B. A. Garro, H. Sossa, and R. A. Vázquez, “Design of artificial neural networks using differential evolution algorithm,” in Proceedings of the 17th International Conference on Neural Information Processing: Models and Applications—Part II (ICONIP '10), vol. 6444 of Lecture Notes in Computer Science, pp. 201–208, Springer, Berlin, Germany, 2010. View at Google Scholar
  3. M. Dorigo and C. Blum, “Ant colony optimization theory: a survey,” Theoretical Computer Science, vol. 344, no. 2-3, pp. 243–278, 2005. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  4. D. Karaboga and B. Basturk, “A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm,” Journal of Global Optimization, vol. 39, no. 3, pp. 459–471, 2007. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  5. D. Karaboga, B. Gorkemli, C. Ozturk, and N. Karaboga, “A comprehensive survey: artificial bee colony (ABC) algorithm and applications,” Artificial Intelligence Review, vol. 42, no. 1, pp. 21–57, 2014. View at Publisher · View at Google Scholar · View at Scopus
  6. D. Karaboga and B. Akay, “Artificial Bee Colony (ABC) algorithm on training artificial neural networks,” in Proceedings of the IEEE 15th Signal Processing and Communications Applications (SIU '07), pp. 1–4, IEEE, Eskişehir, Turkey, June 2007. View at Publisher · View at Google Scholar · View at Scopus
  7. D. Karaboga and B. Basturk, “Artificial bee colony (abc) optimization algorithm for solving constrained optimization problems,” in Proceedings of the 12th International Fuzzy Systems Association World Congress on Foundations of Fuzzy Logic and Soft Computing (IFSA '07), pp. 789–798, Springer, Cancun, Mexico, 2007.
  8. D. Karaboga, B. Akay, and C. Ozturk, “Artificial bee colony (ABC) optimization algorithm for training feed-forward neural networks,” in Proceedings of the 4th International Conference on Modeling Decisions for Artificial Intelligence (MDAI '07), pp. 318–329, Springer, 2007.
  9. D. Karaboga, C. Ozturk, and B. Akay, “Training neural networks with abc optimization algorithm on medical pattern classification,” in Proceedings of the International Conference on Multivariate Statistical Modelling and High Dimensional Data Mining, 2008.
  10. D. Karaboga and C. Ozturk, “Neural networks training by artificial bee colony algorithm on pattern classification,” Neural Network World, vol. 19, no. 3, pp. 21–57, 2009. View at Google Scholar · View at Scopus
  11. S. N. Omkar and J. Senthilnath, “Artificial bee colony for classification of acoustic emission signal source,” International Journal of Aerospace Innovations, vol. 1, no. 3, pp. 129–143, 2009. View at Publisher · View at Google Scholar
  12. B. A. Garro, H. Sossa, and R. A. Vazquez, “Artificial neural network synthesis by means of artificial bee colony (ABC) algorithm,” in Proceedings of the IEEE Congress of Evolutionary Computation (CEC '11), pp. 331–338, New Orleans, La, USA, June 2011. View at Publisher · View at Google Scholar · View at Scopus
  13. R. Irani and R. Nasimi, “Application of artificial bee colony-based neural network in bottom hole pressure prediction in underbalanced drilling,” Journal of Petroleum Science and Engineering, vol. 78, no. 1, pp. 6–12, 2011. View at Publisher · View at Google Scholar · View at Scopus
  14. T. J. Hsieh, H. F. Hsiao, and W. C. Yeh, “Forecasting stock markets using wavelet transforms and recurrent neural networks: an integrated system based on artificial bee colony algorithm,” Applied Soft Computing, vol. 11, no. 2, pp. 2510–2525, 2011. View at Publisher · View at Google Scholar
  15. H. Shah, R. Ghazali, and N. M. Nawi, “Using artificial bee colony algorithm for MLP training on earthquake time series data prediction,” Journal of Computing, vol. 3, no. 6, pp. 135–142, 2011. View at Google Scholar
  16. W.-C. Yeh and T.-J. Hsieh, “Artificial bee colony algorithm-neural networks for S-system models of biochemical networks approximation,” Neural Computing and Applications, vol. 21, no. 2, pp. 365–375, 2012. View at Publisher · View at Google Scholar · View at Scopus
  17. D. Karaboga and B. Akay, “A survey: algorithms simulating bee swarm intelligence,” Artificial Intelligence Review, vol. 31, no. 1–4, pp. 61–85, 2009. View at Publisher · View at Google Scholar · View at Scopus
  18. D. T. Pham, A. J. Soroka, A. Ghanbarzadeh, E. Koc, S. Otri, and M. Packianather, “Optimising neural networks for identification of wood defects using the bees algorithm,” in Proceedings of the IEEE International Conference on Industrial Informatics (INDIN '06), pp. 1346–1351, IEEE, Singapore, August 2006. View at Publisher · View at Google Scholar · View at Scopus
  19. T. Niknam, “Application of honey-bee mating optimization on state estimation of a power distribution system including distributed generators,” Journal of Zhejiang University: Science A, vol. 9, no. 12, pp. 1753–1764, 2008. View at Publisher · View at Google Scholar · View at Scopus
  20. B. Amiri and M. Fathian, “Integration of self organizing feature maps and honey bee mating optimization algorithm for market segmentation,” Journal of Theoretical and Applied Information Technology, vol. 3, pp. 70–86, 2007. View at Google Scholar
  21. W. Maass, “Networks of spiking neurons: the third generation of neural network models,” Neural Networks, vol. 10, no. 9, pp. 1659–1671, 1997. View at Publisher · View at Google Scholar · View at Scopus
  22. F. Rieke, D. Warland, Robert, and W. Bialek, Spikes—Exploring the Neural Code, 1997.
  23. M. E. Hasselmo, C. Bodelón, and B. P. Wyble, “A proposed function for hippocampal theta rhythm: separate phases of encoding and retrieval enhance reversal of prior learning,” Neural Computation, vol. 14, no. 4, pp. 793–817, 2002. View at Publisher · View at Google Scholar · View at Scopus
  24. J. J. Hopfield and C. D. Brody, “What is a moment? ‘Cortical’ sensory integration over a brief interval,” Proceedings of the National Academy of Sciences of the United States of America, vol. 97, no. 25, pp. 13919–13924, 2000. View at Publisher · View at Google Scholar · View at Scopus
  25. S. Loiselle, J. Rouat, D. Pressnitzer, and S. Thorpe, “Exploration of rank order coding with spiking neural networks for speech recognition,” in Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN '05), vol. 4, pp. 2076–2080, Québec, Canada, July-August 2005. View at Publisher · View at Google Scholar
  26. H. Azhar, K. Iftekharuddin, and R. Kozma, “A chaos synchronization-based dynamic vision model for image segmentation,” in Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN '05), vol. 5, pp. 3075–3080, 2005. View at Publisher · View at Google Scholar · View at Scopus
  27. S. J. Thorpe, R. Guyonneau, N. Guilbaud, J.-M. Allegraud, and R. VanRullen, “SpikeNet: real-time visual processing with one spike per neuron,” Neurocomputing, vol. 58–60, pp. 857–864, 2004. View at Publisher · View at Google Scholar · View at Scopus
  28. R. A. Vazquez, B. Girau, and J. C. Quinton, “Visual attention using spiking neural maps,” in Proceedings of the International Joint Conference on Neural Network (IJCNN '11), pp. 2164–2171, August 2011. View at Publisher · View at Google Scholar · View at Scopus
  29. E. A. di Paolo, “Spike-timing dependent plasticity for evolved robots,” Adaptive Behavior, vol. 10, no. 3-4, pp. 243–263, 2003. View at Google Scholar · View at Scopus
  30. D. Floreano, J.-C. Zufferey, and J.-D. Nicoud, “From wheels to wings with evolutionary spiking circuits,” Artificial Life, vol. 11, no. 1-2, pp. 121–138, 2005. View at Publisher · View at Google Scholar · View at Scopus
  31. A. L. Hodgkin, “The local electric changes associated with repetitive action in a non-medullated axon,” The Journal of Physiology, vol. 107, no. 2, pp. 165–181, 1948. View at Publisher · View at Google Scholar
  32. L. F. Abbott, “Lapicque's introduction of the integrate-and-fire model neuron (1907),” Brain Research Bulletin, vol. 50, no. 5-6, pp. 303–304, 1999. View at Publisher · View at Google Scholar · View at Scopus
  33. E. M. Izhikevich, “Simple model of spiking neurons,” IEEE Transactions on Neural Networks, vol. 14, no. 6, pp. 1569–1572, 2003. View at Publisher · View at Google Scholar · View at Scopus
  34. R. FitzHugh, “Impulses and physiological states in theoretical models of nerve membrane,” Biophysical Journal, vol. 1, no. 6, pp. 445–466, 1961. View at Publisher · View at Google Scholar
  35. R. M. Rose and J. L. Hindmarsh, “The assembly of ionic currents in a thalamic neuron. I. The three-dimensional model,” Proceedings of the Royal Society B: Biological Sciences, vol. 237, no. 1288, pp. 267–288, 1989. View at Publisher · View at Google Scholar · View at Scopus
  36. P. Rowcliffe, J. Feng, and H. Buxton, “Clustering within integrate-and-fire neu rons for image segmentation,” in Artificial Neural Networks—ICANN 2002, J. Dorronsoro, Ed., vol. 2415 of Lecture Notes in Computer Science, pp. 69–74, Springer, Berlin, Germany, 2002. View at Publisher · View at Google Scholar
  37. B. Meftah, O. Lezoray, and A. Benyettou, “Segmentation and edge detection based on spiking neural network model,” Neural Processing Letters, vol. 32, no. 2, pp. 131–146, 2010. View at Publisher · View at Google Scholar · View at Scopus
  38. Q. X. Wu, T. M. McGinnity, L. P. Maguire, A. Belatreche, and B. Glackin, “Processing visual stimuli using hierarchical spiking neural networks,” Neurocomputing, vol. 71, no. 10–12, pp. 2055–2068, 2008. View at Publisher · View at Google Scholar · View at Scopus
  39. A. Belatreche, L. P. Maguire, and T. M. McGinnity, “Pattern recognition with spiking neural networks and dynamic synapse,” in Proceedings of the International FLINS Conference on Applied computational intelligence, pp. 205–210, 2004.
  40. J. J. Wade, L. J. McDaid, J. A. Santos, and H. M. Sayers, “SWAT: a spiking neural network training algorithm for classification problems,” IEEE Transactions on Neural Networks, vol. 21, no. 11, pp. 1817–1830, 2010. View at Publisher · View at Google Scholar · View at Scopus
  41. Q. Yu, K. Tan, and H. Tang, “Pattern recognition computation in a spiking neural network with temporal encoding and learning,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN '12), pp. 1–7, IEEE, Brisbane, Australia, June 2012. View at Publisher · View at Google Scholar · View at Scopus
  42. H. N. Abdull Hamed, N. Kasabov, Z. Michlovský, and S. M. Shamsuddin, “String pattern recognition using evolving spiking neural networks and quantum inspired particle swarm optimization,” in Neural Information Processing: 16th International Conference, ICONIP 2009, Bangkok, Thailand, December 1–5, 2009, Proceedings, Part II, vol. 5864 of Lecture Notes in Computer Science, pp. 611–619, Springer, Berlin, Germany, 2009. View at Publisher · View at Google Scholar
  43. N. Kasabov, “Evolving spiking neural networks for spatio-and spectro-temporal pattern recognition,” in Proceedings of the 6th IEEE International Conference Intelligent Systems (IS '12), pp. 27–32, September 2012. View at Publisher · View at Google Scholar · View at Scopus
  44. S. M. Bohte, J. N. Kok, and H. la Poutré, “Error-backpropagation in temporally encoded networks of spiking neurons,” Neurocomputing, vol. 48, no. 1–4, pp. 17–37, 2002. View at Publisher · View at Google Scholar · View at Scopus
  45. B. Schrauwen and J. van Campenhout, “Extending SpikeProp,” in Proceedings of the IEEE International Joint Conference on Neural Networks, vol. 1, pp. 471–475, July 2004. View at Scopus
  46. J. Xin and M. J. Embrechts, “Supervised learning with spiking neural networks,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN '01), vol. 3, pp. 1772–1777, July 2001. View at Scopus
  47. R. P. N. Rao, “Hierarchical bayesian infere nce in networks of spiking neurons,” in Advances in Neural Information Processing Systems, vol. 17, MIT Press, 2005. View at Google Scholar
  48. S. Deneve, “Bayesian spiking neurons. I: inference,” Neural Computation, vol. 20, no. 1, pp. 91–117, 2008. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  49. N. Kasabov, “To spike or not to spike: a probabilistic spiking neuron model,” Neural Networks, vol. 23, no. 1, pp. 16–19, 2010. View at Publisher · View at Google Scholar · View at Scopus
  50. D. Barber, “Learning in spiking neural assemblies,” in Proceedings of the 16th Annual Neural Information Processing Systems Conference (NIPS '02), December 2002. View at Scopus
  51. G. Chechik, “Spike-timing-dependent plasticity and relevant mutual information maximization,” Neural Computation, vol. 15, no. 7, pp. 1481–1510, 2003. View at Publisher · View at Google Scholar · View at Scopus
  52. J. P. Pfister, T. Toyoizumi, D. Barber, and W. Gerstner, “Optimal spike-timing-dependent plasticity for precise action potential firing in supervised learning,” Neural Computation, vol. 18, no. 6, pp. 1318–1348, 2006. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  53. H. S. Seung, “Learning in spiking neural networks by reinforcement of stochastic synaptic transmission,” Neuron, vol. 40, no. 6, pp. 1063–1073, 2003. View at Publisher · View at Google Scholar · View at Scopus
  54. E. M. Izhikevich, “Solving the distal reward problem through linkage of STDP and dopamine signaling,” Cerebral Cortex, vol. 17, no. 10, pp. 2443–2452, 2007. View at Publisher · View at Google Scholar · View at Scopus
  55. R. Legenstein, D. Pecevski, and W. Maass, “A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback,” PLoS Computational Biology, vol. 4, no. 10, Article ID e1000180, 2008. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  56. S. Schliebs, M. Defoin-Platel, S. Worner, and N. Kasabov, “Integrated feature and parameter optimization for an evolving spiking neural network: exploring heterogeneous probabilistic models,” Neural Networks, vol. 22, no. 56, pp. 623–632, 2009, Advances in Neural Networks Research: International Joint Conference on Neural Networks (IJCNN'09). View at Google Scholar
  57. A. Cachón and R. A. Vázquez, “Tuning the parameters of an integrate and fire neuron via a genetic algorithm for solving pattern recognition problems,” Neurocomputing, vol. 148, pp. 187–197, 2015. View at Publisher · View at Google Scholar
  58. R. A. Vazquez and A. Cachón, “Integrate and Fire neurons and their application in pattern recognition,” in Proceedings of the 7th International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE '10), pp. 424–428, September 2010. View at Publisher · View at Google Scholar · View at Scopus
  59. R. Vazquez, “Izhikevich neuron model and its application in pattern recognition,” Australian Journal of Intelligent Information Processing Systems, vol. 11, no. 1, pp. 35–40, 2010. View at Google Scholar
  60. R. A. Vázquez, “Pattern recognition using spiking neurons and firing rates,” in Advances in Artificial Intelligence—IBERAMIA 2010: Proceedings of the 12th Ibero-American Conference on AI, Bahía Blanca, Argentina, November 1–5, 2010, vol. 6433 of Lecture Notes in Computer Science, pp. 423–432, Springer, Berlin, Germany, 2010. View at Publisher · View at Google Scholar
  61. R. A. Vazquez, “Training spiking neural models using cuckoo search algorithm,” in Proceedings of the IEEE Congress of Evolutionary Computation (CEC '11), pp. 679–686, June 2011. View at Publisher · View at Google Scholar · View at Scopus
  62. R. A. Vázquez and B. A. Garro, “Training spiking neurons by means of particle swarm optimization,” in Advances in Swarm Intelligence: 1st International Conference, ICSI 2010, Beijing, China, June 12–15, 2010, Proceedings, vol. 6728 of Lecture Notes in Computer Science, Part I, pp. 242–249, Springer, Berlin, Germany, 2011. View at Publisher · View at Google Scholar
  63. W. Gerstner and W. M. Kistler, Spiking Neuron Models: Single Neurons, Populations, Plasticity, Cambridge University Press, Cambridge, UK, 2002. View at Publisher · View at Google Scholar · View at MathSciNet
  64. E. M. Izhikevich, “Which model to use for cortical spiking neurons?” IEEE Transactions on Neural Networks, vol. 15, no. 5, pp. 1063–1070, 2004. View at Publisher · View at Google Scholar · View at Scopus
  65. E. M. Izhikevich, Dynamical Systems in Neuroscience: the Geometry of Excitability and Bursting, Computational Neuroscience, MIT Press, 2007. View at MathSciNet
  66. P. M. Murphy and D. W. Aha, “UCI repository of machine learning databases,” Tech. Rep., Department of Information and Computer Science, University of California, Irvine, Calif, USA, 1994. View at Google Scholar
  67. R. A. V. E. de Los Monteros and J. H. S. Azuela, “A new associative model with dynamical synapses,” Neural Processing Letters, vol. 28, no. 3, pp. 189–207, 2008. View at Publisher · View at Google Scholar · View at Scopus
  68. N. Otsu, “A threshold selection method from gray-level histograms,” IEEE Transactions on Systems, Man and Cybernetics, vol. 9, no. 1, pp. 62–66, 1979. View at Publisher · View at Google Scholar · View at Scopus
  69. R. Jain and R. K. B. G. Schunck, Machine Vision, McGraw-Hill, 1995.
  70. M.-K. Hu, “Visual pattern recognition by moment invariants,” IEEE Transactions on Information Theory, vol. 8, no. 2, pp. 179–187, 1962. View at Publisher · View at Google Scholar
  71. M. I. A. Lourakis, A Brief Description of the Levenberg-Marquardt Algorithm Implemented by Levmar, Foundation for Research and Technology-Hellas, Vassilika Vouton, Crete, GREECE, 2005.
  72. A. Bermak and D. Martinez, “A compact 3D VLSI classifier using bagging threshold network ensembles,” IEEE Transactions on Neural Networks, vol. 14, no. 5, pp. 1097–1109, 2003. View at Publisher · View at Google Scholar · View at Scopus
  73. B. A. Garro, R. A. Vazquez, and K. Rodríguez, “Classification of DNA microarrays using artificial bee colony (ABC) algorithm,” in Advances in Swarm Intelligence, Y. Tan, Y. Shi, and C. Coello, Eds., vol. 8794 of Lecture Notes in Computer Science, pp. 207–214, Springer, 2014. View at Publisher · View at Google Scholar
  74. T. R. Golub, D. K. Slonim, P. Tamayo et al., “Molecular classification of cancer: class discovery and class prediction by gene expression monitoring,” Science, vol. 286, no. 5439, pp. 531–527, 1999. View at Publisher · View at Google Scholar · View at Scopus