Table of Contents Author Guidelines Submit a Manuscript
Mathematical Problems in Engineering
Volume 2013, Article ID 459503, 13 pages
http://dx.doi.org/10.1155/2013/459503
Research Article

A Constructive Data Classification Version of the Particle Swarm Optimization Algorithm

Natural Computing Laboratory, Mackenzie University, Rua da Consolação 930, 01302-907 São Paulo, Brazil

Received 2 October 2012; Revised 1 November 2012; Accepted 8 November 2012

Academic Editor: Baozhen Yao

Copyright © 2013 Alexandre Szabo and Leandro Nunes de Castro. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. G. E. A. P. A. Batista and M. C. Monard, “An analysis of four missing data treatment methods for supervised learning,” Applied Artificial Intelligence, vol. 17, no. 5-6, pp. 519–533, 2003. View at Google Scholar · View at Scopus
  2. Y. Yang and X. Liu, “A re-examination of text categorization methods,” in Proceedings of the 22nd ACM International Conference on Research and Development in Information Retrieval, pp. 42–49, Berkeley, Calif, USA, 1999.
  3. X. Yi and Y. Zhang, “Privacy-preserving naive Bayes classification on distributed data via semi-trusted mixers,” Information Systems, vol. 34, no. 3, pp. 371–380, 2009. View at Publisher · View at Google Scholar · View at Scopus
  4. J. Han and M. Kamber, Data Mining: Concepts and Techniques, Morgan Kaufman Press, 2000.
  5. C. Westphal and T. Blaxton, Data Mining Solutions: Methods and Tools for Solving Real-World Problems, Wiley Computer Publishing, New York, NY, USA, 1998.
  6. L. M. Silva, J. Marques de Sá, and L. A. Alexandre, “Data classification with multilayer perceptrons using a generalized error function,” Neural Networks, vol. 21, no. 9, pp. 1302–1310, 2008. View at Publisher · View at Google Scholar · View at Scopus
  7. B. Gabrys and A. Bargiela, “General fuzzy min-max neural network for clustering and classification,” IEEE Transactions on Neural Networks, vol. 11, no. 3, pp. 769–783, 2000. View at Publisher · View at Google Scholar · View at Scopus
  8. T. Kohonen, Self-Organizing Maps, vol. 30, Springer, Berlin, Germany, 2nd edition, 1997. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  9. T. Kohonen, Improved Versions of Learning Vector Quantization, Helsinki University of Technology, Helsinki, Finland, 1990.
  10. G. R. Lloyd, R. G. Brereton, R. Faria, and J. C. Duncan, “Learning vector quantization for multiclass classification: application to characterization of plastics,” Journal of Chemical Information and Modeling, vol. 47, no. 4, pp. 1553–1563, 2007. View at Publisher · View at Google Scholar · View at Scopus
  11. R. K. Madyastha and B. Aazhang, “Algorithm for training multilayer perceptrons for data classification and function interpolation,” IEEE Transactions on Circuits and Systems I, vol. 41, no. 12, pp. 866–875, 1994. View at Publisher · View at Google Scholar · View at Scopus
  12. J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proceedings of IEEE International Conference on Neural Networks (Perth, Australia), pp. 1942–1948, Piscataway, NJ, USA, December 1995. View at Scopus
  13. S. C. M. Cohen and L. N. de Castro, “Data clustering with particle swarms,” in Proceedings of the World Congress on Computational Intelligence, pp. 6256–6262, Vancouver, Canada, 2006.
  14. T. Kohonen, “The self-organizing map,” Proceedings of the IEEE, vol. 78, no. 9, pp. 1464–1480, 1990. View at Publisher · View at Google Scholar · View at Scopus
  15. A. K. F. Prior and L. N. de Castro, “Um Algoritmo de Enxame Construtivo Para Agrupamento de Dados,” in Proceedings of the 18th Congresso Brasileiro de Automática, pp. 3300–3307, Bonito, Brazil, 2010.
  16. F. M. Burnet, The Clonal Selection of Acquired Immunity, Cambridge University Press, London, UK, 1959.
  17. W. S. McCulloch and W. Pitts, “A logical calculus of the ideas immanent in nervous activity,” Bulletin of Mathematical Biophysics, vol. 5, pp. 115–133, 1943. View at Google Scholar · View at Zentralblatt MATH
  18. T. Bäck, D.B. Fogel, and Z. Michalewicz, Evolutionary Computation: Basic Algorithms and Operators, Institute of Physics Publishing, Bristol, UK, 2000. View at Publisher · View at Google Scholar
  19. T. Bäck, “Evolutionary algorithms: comparison of approaches,” in Computing with Biological Metaphors, R. Paton, Ed., pp. 227–243, Chapman & Hall, 1994. View at Google Scholar
  20. D. B. Fogel, Evolutionary Computation: Toward a New Philosophy of Machine Intelligence, IEEE Press, Piscataway, NJ, USA, 2nd edition, 2000.
  21. G. Beni and J. Wang, “Swarm intelligence,” in Proceedings of the 7th Annual Meeting of the Robotics Society of Japan, pp. 425–428, 1989.
  22. E. Bonabeau, G. Theraulaz, J. L. Deneubourg, S. Aron, and S. Camazine, “Self-organization in social insects,” Trends in Ecology and Evolution, vol. 12, no. 5, pp. 188–193, 1997. View at Publisher · View at Google Scholar · View at Scopus
  23. N. R. Franks, “Army ants: a collective intelligence,” American Scientist, vol. 77, no. 2, pp. 138–145, 1989. View at Google Scholar · View at Scopus
  24. L. N. de Castro and J. Timmis, Artificial Immune Systems: A New Computational Intelligence Approach, Springer, 2002.
  25. E. Hart and J. Timmis, “Application areas of AIS: the past, the present and the future,” Applied Soft Computing Journal, vol. 8, no. 1, pp. 191–201, 2008. View at Publisher · View at Google Scholar · View at Scopus
  26. L. N. de Castro, “Fundamentals of natural computing: an overview,” Physics of Life Reviews, vol. 4, no. 1, pp. 1–36, 2007. View at Publisher · View at Google Scholar · View at Scopus
  27. E. O. Wilson, Sociobiology: The New Synthesis, Belknap Press, Cambridge, Mass, USA, 1975.
  28. E. Bonabeau, M. Dorigo, and G. Theraulaz, Swarm Intelligence: From Natural to Artificial Systems, Oxford University Press, New York, NY, USA, 1999.
  29. J. Kennedy, R. Eberhart, and Y. Shi, Swarm Intelligence, Morgan Kaufman Publishers, 2001.
  30. B. J. Zhao, “An ant colony clustering algorithm,” in Proceedings of the 6th International Conference on Machine Learning and Cybernetics (ICMLC '07), pp. 3933–3938, Hong Kong, August 2007. View at Publisher · View at Google Scholar · View at Scopus
  31. A. Szabo, A. K. F. Prior, and L. N. De Castro, “The proposal of a velocity memoryless clustering swarm,” in 6th IEEE World Congress on Computational Intelligence (WCCI '10), Barcelona, Spain, July 2010. View at Publisher · View at Google Scholar · View at Scopus
  32. R. Poli, J. Kennedy, and T. Blackwell, “Particle swarm optimization: an overview,” Swarm Intelligence, vol. 1, pp. 33–57, 2007. View at Google Scholar
  33. D. W. van der Merwe and A. P. Engelbrecht, “Data clustering using particle swarm optimization,” in Proceedings of IEEE Congress on Evolutionary Computation (CEC '03), pp. 215–220, Canberra, Australia, 2003.
  34. A. Cervantes, I. Galván, and P. Isasi, “A Comparison between the Pittsburgh and Michigan Approaches for the Binary PSO Algorithm,” in Proceedings of IEEE Congress on Evolutionary Computation (CEC '05), pp. 290–305, September 2005. View at Scopus
  35. A. Cervantes, I. M. Galván, and P. Isasi, “AMPSO: a new particle swarm method for nearest neighborhood classification,” IEEE Transactions on Systems, Man, and Cybernetics B, vol. 39, no. 5, pp. 1082–1091, 2009. View at Publisher · View at Google Scholar · View at Scopus
  36. T. Sousa, A. Silva, and A. Neves, “Particle Swarm based Data Mining Algorithms for classification tasks,” Parallel Computing, vol. 30, no. 5-6, pp. 767–783, 2004. View at Publisher · View at Google Scholar · View at Scopus
  37. N. Holden and A. A. Freitas, “A hybrid particle swarm/ant colony algorithm for the classification of hierarchical biological data,” in Proceedings of IEEE Swarm Intelligence Symposium (SIS '05), pp. 100–107, Pasadena, Calif, USA, June 2005. View at Publisher · View at Google Scholar · View at Scopus
  38. K. Y. Huang, “A hybrid particle swarm optimization approach for clustering and classification of datasets,” Knowledge-Based Systems, vol. 24, no. 3, pp. 420–426, 2011. View at Publisher · View at Google Scholar · View at Scopus
  39. Q. Shen, W. M. Shi, and W. Kong, “Hybrid particle swarm optimization and tabu search approach for selecting genes for tumor classification using gene expression data,” Computational Biology and Chemistry, vol. 32, no. 1, pp. 52–59, 2008. View at Publisher · View at Google Scholar · View at Scopus
  40. Z. Wang, X. Sun, and D. Zhang, “A PSO-based classification rule mining algorithm,” in Advanced Intelligent Computing Theories and Applications, vol. 4682, pp. 377–384, Springer, Berlin, Germany, 2007. View at Google Scholar
  41. S. Kalyani and K. S. Swarup, “Classifier design for static security assessment using particle swarm optimization,” Applied Soft Computing Journal, vol. 11, no. 1, pp. 658–666, 2011. View at Publisher · View at Google Scholar · View at Scopus
  42. H. Izakian and A. Abraham, “Fuzzy C-means and fuzzy swarm for fuzzy clustering problem,” Expert Systems with Applications, vol. 38, no. 3, pp. 1835–1838, 2011. View at Publisher · View at Google Scholar · View at Scopus
  43. Q. Shen, J. H. Jiang, C. X. Jiao, G. L. Shen, and R. Q. Yu, “Modified particle swarm optimization algorithm for variable selection in MLR and PLS modeling: QSAR studies of antagonism of angiotensin II antagonists,” European Journal of Pharmaceutical Sciences, vol. 22, no. 2-3, pp. 145–152, 2004. View at Publisher · View at Google Scholar · View at Scopus
  44. Q. Shen, J. H. Jiang, C. X. Jiao, S. Y. Huan, G. L. Shen, and R. Q. Yu, “Optimized partition of minimum spanning tree for piecewise modeling by particle swarm algorithm. QSAR studies of antagonism of angiotensin II antagonists,” Journal of Chemical Information and Computer Sciences, vol. 44, no. 6, pp. 2027–2031, 2004. View at Publisher · View at Google Scholar · View at Scopus
  45. S. C. Satapathy, J. V. R. Murthy, P. V. G. D. Prasad Reddy, B. B. Misra, P. K. Dash, and G. Panda, “Particle swarm optimized multiple regression linear model for data classification,” Applied Soft Computing Journal, vol. 9, no. 2, pp. 470–476, 2009. View at Publisher · View at Google Scholar · View at Scopus
  46. W. F. Leong and G. G. Yen, “PSO-based multiobjective optimization with dynamic population size and adaptive local archives,” IEEE Transactions on Systems, Man, and Cybernetics B, vol. 38, no. 5, pp. 1270–1293, 2008. View at Publisher · View at Google Scholar · View at Scopus
  47. B. Soudan and M. Saad, “An evolutionary dynamic population size PSO implementation,” in Proceedings of the 3rd International Conference on Information and Communication Technologies: From Theory to Applications (ICTTA '08), pp. 1–5, April 2008. View at Publisher · View at Google Scholar · View at Scopus
  48. S. Sun, G. Ye, Y. Liang, Y. Liu, and Q. Pan, “Dynamic population size based particle swarm optimization,” Lecture Notes in Computer Science, Advances in Computation and Intelligence, vol. 4683, pp. 382–392, 2007. View at Google Scholar · View at Scopus
  49. K. C. Tan, T. H. Lee, and E. F. Khor, “Evolutionary algorithms with dynamic population size and local exploration for multiobjective optimization,” IEEE Transactions on Evolutionary Computation, vol. 5, no. 6, pp. 565–588, 2001. View at Publisher · View at Google Scholar · View at Scopus
  50. D. Chen and C. Zhao, “Particle swarm optimization with adaptive population size and its application,” Applied Soft Computing Journal, vol. 9, no. 1, pp. 39–48, 2009. View at Publisher · View at Google Scholar · View at Scopus
  51. G. G. Yen and H. Lu, “Dynamic population strategy assisted particle swarm optimization,” in Proceedings of IEEE International Symposium on Intelligent Control, pp. 697–702, October 2003. View at Scopus
  52. X. Cui and T. E. Potok, “Document clustering analysis based on hybrid PSO+K-means algorithm,” The Journal of Computer Science, Special issue on Efficient heuristics for information organization, Science Publications, New York, NY, USA, 2005.
  53. J. Dong and M. Qi, “A new algorithm for clustering based on particle swarm optimization and K-means,” in Proceedings of the International Conference on Artificial Intelligence and Computational Intelligence (AICI '09), vol. 4, pp. 264–268, November 2009. View at Publisher · View at Google Scholar · View at Scopus
  54. F. T. Niknam and M. Nayeripour, “A new evolutionary algorithm for cluster analysis,” World Academy of Science, Engineering and Technology, vol. 46, pp. 584–588, 2008. View at Google Scholar
  55. S. Alam, G. Dobbie, and P. Riddle, “An evolutionary particle swarm optimization algorithm for data clustering,” in Proceedings of IEEE Swarm Intelligence Symposium (SIS '08), pp. 1–6, September 2008. View at Publisher · View at Google Scholar · View at Scopus
  56. M. G. H. Omran, A. P. Engelbrecht, and A. Salman, “Dynamic clustering using particle swarm optimization with application in unsupervised image classification,” Transactions on Engineering, Computing and Technology, vol. 9, pp. 199–204, 2005. View at Google Scholar
  57. L. N. de Castro, F. J. Von Zuben, and G. A. de Deus, “The construction of a Boolean competitive neural network using ideas from immunology,” Neurocomputing, vol. 50, pp. 51–85, 2003. View at Publisher · View at Google Scholar · View at Scopus
  58. I. H. Witten and E. Frank, Data Mining—Practical Machine Learning Tools and Techniques, Morgan Kaufman, San Fransisco, Calif, USA, 2005.
  59. S. S. Shapiro and M. B. Wilk, “An analysis of variance test for normality: complete samples,” Biometrika, vol. 52, pp. 591–611, 1965. View at Google Scholar · View at Zentralblatt MATH
  60. M. Friedman, “The use of ranks to avoid the assumption of normality implicit in the analysis of variance,” Journal of the American Statistical Association, vol. 32, pp. 675–701, 1937. View at Google Scholar
  61. J. Derrac, S. García, D. Molina, and F. Herrera, “A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms,” Swarm and Evolutionary Computation, vol. 1, no. 1, pp. 3–18, 2011. View at Publisher · View at Google Scholar · View at Scopus
  62. R. A. Fisher, Statistical Methods and Scientific Inference, Hafner Publishing Company, New York, NY, USA, 2nd edition, 1959.
  63. F. R. Pisani and R. Purves, Statistics, W.W. Norton & Company, New York, NY, USA, 3rd edition, 1998.