Table of Contents Author Guidelines Submit a Manuscript
Abstract and Applied Analysis
Volume 2014, Article ID 318478, 9 pages
http://dx.doi.org/10.1155/2014/318478
Research Article

A New Method for Solving Supervised Data Classification Problems

1Centre for Artificial Intelligence and Robotics, Universiti Teknologi Malaysia, 54100 Kuala Lumpur, Malaysia
2Malaysia-Japan International Institute of Technology (MJIIT), Universiti Teknologi Malaysia, 54100 Kuala Lumpur, Malaysia

Received 14 July 2014; Revised 19 October 2014; Accepted 6 November 2014; Published 27 November 2014

Academic Editor: Luiz Duarte

Copyright © 2014 Parvaneh Shabanzadeh and Rubiyah Yusof. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. L. Breinman, R. A. Olshen, and C. J. Stone, Classification Adregression Trees, Wadsworth & Brooks, Pacific Grove, Calif, USA, 1984.
  2. G. P. Zhang, “Neural networks for classification: a survey,” IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews, vol. 30, no. 4, pp. 451–462, 2000. View at Publisher · View at Google Scholar · View at Scopus
  3. A. Freitas, “A survey of evolutionary algorithms for datamining and knowledge discovery,” in Advances in Evolutionary Computation, Springer, 2002. View at Google Scholar
  4. W. Buntine, “Graphical models for discovering knowledge,” in Advances in Knowledge Discovery and Data Mining, pp. 59–82, 1996. View at Google Scholar
  5. J. H. Friedman, “Multivariate adaptive regression splines,” The Annals of Statistics, vol. 19, no. 1, pp. 1–141, 1991. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  6. S. Dzeroski, “Inductive logic programming and knowledge discovery in databases,” in Advances in Knowledge Discovery and Data Mining, pp. 117–152, 1996. View at Google Scholar
  7. B. Boutsinas and M. N. Vrahatis, “Artificial nonmonotonic neural networks,” Artificial Intelligence, vol. 132, no. 1, pp. 1–38, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  8. S. B. Kotsiantis, “Supervised machine learning: a review of classification techniques,” Informatica, vol. 31, no. 3, pp. 249–268, 2007. View at Google Scholar · View at MathSciNet · View at Scopus
  9. O. L. Mangasarian and D. R. Musicant, “Lagrangian support vector machines,” Journal of Machine Learning Research, vol. 1, no. 3, pp. 161–177, 2001. View at Publisher · View at Google Scholar · View at Scopus
  10. P. S. Bradley and O. L. Mangasarian, “Massive data discrimination via linear support vector machines,” Optimization Methods and Software, vol. 13, no. 1, pp. 1–10, 2000. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  11. O. L. Mangasarian, E. W. Wild, and G. M. Fung, “Proximal knowledge-based classification,” Statistical Analysis and Data Mining, vol. 1, no. 4, pp. 215–222, 2009. View at Publisher · View at Google Scholar · View at Scopus
  12. O. L. Mangasarian and E. W. Wild, “Nonlinear knowledge-based classification,” IEEE Transactions on Neural Networks, vol. 19, no. 10, pp. 1826–1832, 2008. View at Publisher · View at Google Scholar · View at Scopus
  13. A. M. Bagirov, A. M. Rubinov, and J. Yearwood, “Using global optimization to improve classification for medical diagnosis and prognosis,” Topics in Health Information Management, vol. 22, no. 1, pp. 65–74, 2001. View at Google Scholar · View at Scopus
  14. Y. Liu, G. Wang, H. Chen, H. Dong, X. Zhu, and S. Wang, “An improved particle swarm optimization for feature selection,” Journal of Bionic Engineering, vol. 8, no. 2, pp. 191–200, 2011. View at Publisher · View at Google Scholar · View at Scopus
  15. I. Iguyon and A. Elisseeff, “An introduction to variable and feature selection,” Journal of Machine Learning Research, vol. 3, pp. 1157–1182, 2003. View at Google Scholar · View at Scopus
  16. P. S. Bradley and O. L. Mangasarian, “Feature selection via concave minimization and support vector machines,” in Proceedings of the 15th International Conference on Machine Learning (ICML '98), Morgan Kaufmann, San Francisco, Calif, USA, 1998.
  17. A. M. Bagirov, B. Ferguson, S. Ivkovic, G. Saunders, and J. Yearwood, “New algorithms for multi-class cancer diagnosis using tumor gene expression signatures,” Bioinformatics, vol. 19, no. 14, pp. 1800–1807, 2003. View at Publisher · View at Google Scholar · View at Scopus
  18. A. M. Bagirov, A. M. Rubinov, and J. Yearwood, “A heuristic algorithm for feature selection based on optimization techniques,” in Heuristic and Optimization for Knowledge Discovery, R. A. Sarker, H. A. Abbas, and C. Newton, Eds., pp. 13–26, Idea Group Publishing, London, UK, 2002. View at Google Scholar
  19. C. Audet and J. E. Dennis Jr., “Mesh adaptive direct search algorithms for constrained optimization,” SIAM Journal on Optimization, vol. 17, no. 1, pp. 188–217, 2007. View at Publisher · View at Google Scholar · View at Scopus
  20. A. M. Bagirov, “Modified global k-means algorithm for minimum sum-of-squares clustering problems,” Pattern Recognition, vol. 41, no. 10, pp. 3192–3199, 2008. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  21. M. Fathian, B. Amiri, and A. Maroosi, “Application of honey-bee mating optimization algorithm on clustering,” Applied Mathematics and Computation, vol. 190, no. 2, pp. 1502–1513, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  22. A. Likas, N. Vlassis, and J. J. Verbeek, “The global k-means clustering algorithm,” Pattern Recognition, vol. 36, no. 2, pp. 451–461, 2003. View at Publisher · View at Google Scholar · View at Scopus
  23. M. Kudo and J. Sklansky, “Comparison of algorithms that select features for pattern classifiers,” Pattern Recognition, vol. 33, no. 1, pp. 25–41, 2000. View at Publisher · View at Google Scholar · View at Scopus
  24. Z. Zhao, J. C. Meza, and M. V. Hove, “Using pattern search methods for surface structure determination of nanomaterials,” Journal of Physics: Condensed Matter, vol. 18, pp. 8693–8706, 2006. View at Google Scholar
  25. C. L. Blake and C. J. Merz, “UCI repository of machine learning databases,” 1998, http://archive.ics.uci.edu/ml/datasets.html.
  26. O. L. Mangasarian, “Misclassification minimization,” Journal of Global Optimization, vol. 5, no. 4, pp. 309–323, 1994. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  27. K. P. Bennett and O. L. Mangasarian, “Robust linear programming discrimination of two linearly inseparable sets,” Optimization Methods and Software, vol. 1, no. 1, pp. 23–34, 1992. View at Publisher · View at Google Scholar · View at Scopus
  28. C. Chen and O. L. Mangasarian, “Hybrid misclassification minimization,” Mathematical Programming Technical Report no. 95–05, University of Wisconsin, 1995. View at Google Scholar
  29. P. S. Bradley and O. L. Mangasarian, “Feature selection via concave minimization and support vector machines,” in Proceedings of the 15th International Conference on Machine Learning (ICML '98), 1998.
  30. S. S. Keerthi, S. K. Shevade, C. Bhattacharyya, and K. R. K. Murthy, “Improvements to Platt's SMO algorithm for SVM classifier design,” Neural Computation, vol. 13, no. 3, pp. 637–649, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  31. J. C. Platt, “Fast training of support vector machines using sequential minimal optimization,” in Advances in Kernel Methods: Support Vector Learning, pp. 185–208, MIT Press, Cambridge, Mass, USA, 1999. View at Google Scholar
  32. I. de Falco, A. Della Cioppa, and E. Tarantino, “Facing classification problems with Particle Swarm Optimization,” Applied Soft Computing Journal, vol. 7, no. 3, pp. 652–658, 2007. View at Publisher · View at Google Scholar · View at Scopus
  33. H. A. Firpi and E. Goodman, “Swarmed feature selection,” in Proceedings of the 33rd Applied Imagery Pattern Recognition Workshop, pp. 112–118, IEEE, Washington, DC, USA, October 2005. View at Publisher · View at Google Scholar · View at Scopus
  34. Z. W. Geem, Music-Inspired Harmony Search Algorithm: Theory and Applications, Springer, New York, NY, USA, 1st edition, 2009.
  35. H. Banati and M. Bajaj, “Fire fly based feature selection approach,” International Journal of Computer Science Issues, vol. 8, no. 4, pp. 473–480, 2011. View at Google Scholar
  36. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tool and Technique with Java Implementation, Morgan Kaufmann, San Francisco, Calif, USA, 2000.
  37. M. H. Hassoun, Fundamentals of Artificial Neural Networks, The MIT Press, 1995.
  38. J. G. Cleary and L. E. Trigg, “K*: an instance-based learner using an entropic distance measure,” in Proceedings of the 12th International Conference on Machine Learning, pp. 108–114, 1995.
  39. P. Compton and R. Jansen, “Knowledge in context: a strategy for expert system maintenance,” in Proceedings of the 2nd Australian Joint Artificial Intelligence Conference (Ai '88), Lecture Notes in Computer Science, Adelaide, Australia, November 1988.
  40. G. Demiröz and A. Güvenir, “Classification by voting feature intervals,” in Machine Learning: ECML-97, vol. 1224 of Lecture Notes in Computer Science Volume, pp. 85–92, 1997. View at Publisher · View at Google Scholar
  41. R. Kohavi, “Scaling up the accuracy of naive-bayes classifiers: a decision tree hybrid,” in Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, AAAI Press, 1996.
  42. F. Jensen, An Introduction to Bayesian Networks, UCL Press/Springer, Berlin, Germany, 1996.
  43. N. Jankowski and V. Kadirkamanathan, “Statistical control of RBF-like networks for classification,” in Proceedings of the 7th International Conference on Artificial Neural Networks (ICANN '97), Lausanne, Switzerland, 1997.
  44. W.-H. Au and K. C. C. Chan, “Classification with degree of membership: a fuzzy approach,” in Proceedings of the 1st IEEE International Conference on Data Mining (ICDM '01), pp. 35–42, December 2001. View at Scopus
  45. L. Rutkowski and K. Cpalka, “Flexible neuro-fuzzy systems,” IEEE Transactions on Neural Networks, vol. 14, no. 3, pp. 554–574, 2003. View at Publisher · View at Google Scholar · View at Scopus
  46. W. D. Leon, “Enhancing pattern classification with relational fuzzy neural networks and square BK-products,” in Computer Science, pp. 71–74, Springer, New York, NY, USA, 2006. View at Google Scholar
  47. D. T. Pham, S. S. Dimov, and Z. Salem, “Technique for selecting examples in inductive learning,” in Proceedings of the European Symposium on Intelligent Techniques (ESIT '00), Aachen, Germany, 2000.
  48. W. P. Eklund and A. Hoang, “Comparative study of public-domain supervised machine-learning accuracy on the UCI database,” in Data Mining and Knowledge Discovery: Theory, Tools, and Technology, V. D. Belur, Ed., vol. 3695 of Proceedings of SPIE, pp. 39–50, 1999.
  49. N. Friedman, D. Geiger, and M. Goldszmidt, “Bayesian network classifiers,” Machine Learning, vol. 29, no. 2-3, pp. 131–163, 1997. View at Publisher · View at Google Scholar · View at Scopus
  50. H. J. George and P. Langley, “Estimating continuous distributions in Bayesian classifiers,” in Proceedings of the 11th Conference on Uncertainty in Artificial Intelligence, pp. 338–345, Morgan Kaufman, San Mateo, Calif, USA, 1995.
  51. N. Cheung, Machine learning techniques for medical analysis [M.S. thesis], School of Information Technology and Electrical Engineering, University of Queensland, Queensland, Australia, 2001.
  52. Y.-J. Lee and O. L. Mangasarian, “SSVM: a smooth support vector machine for classification,” Computational Optimization and Applications, vol. 20, no. 1, pp. 5–22, 2001. View at Publisher · View at Google Scholar · View at Scopus
  53. Y. J. Lee and O. L. Mangasarian, “RSVM: reduced support vector machines,” in Proceedings of the 1st SIAM International Conference on Data Mining, Chicago, Ill, USA, 2001.
  54. T. van Gestel, J. A. K. Suykens, G. Lanckriet, A. Lambrechts, B. de Moor, and J. Vandewalle, “Bayesian framework for least-squares support vector machine classifiers, Gaussian processes, and Kernel fisher discriminant analysis,” Neural Computation, vol. 14, no. 5, pp. 1115–1147, 2002. View at Publisher · View at Google Scholar · View at Scopus
  55. E. Çomak, K. Polat, S. Güneş, and A. Arslan, “A new medical decision making system: least square support vector machine (LSSVM) with fuzzy weighting pre-processing,” Expert Systems with Applications, vol. 32, no. 2, pp. 409–414, 2007. View at Publisher · View at Google Scholar · View at Scopus
  56. J. Tian, M. Li, and F. Chen, “Dual-population based coevolutionary algorithm for designing RBFNN with feature selection,” Expert Systems with Applications, vol. 37, no. 10, pp. 6904–6918, 2010. View at Publisher · View at Google Scholar · View at Scopus
  57. Y. Freund and R. E. Schapire, “Experiments with a new boosting algorithm,” in Proceedings of the 13th International Conference on Machine Learning, pp. 148–156, San Francisco, Calif, USA, 1996.
  58. E. Frank and I. H. Witten, “Generating accurate rule sets without global optimization,” in Proceedings of the 15th International Conference on Machine Learning, J. W. Shavlik, Ed., pp. 144–151, Morgan Kaufmann, San Francisco, Calif, USA, 1998.
  59. C. Jesus and L. M. Ramon, “The indifferent naive Bayes classifier,” in Proceedings of the 16th International FLAIRS Conference, pp. 341–345, 2003.
  60. K. Polat, S. Şahan, H. Kodaz, and S. Güneş, “Breast cancer and liver disorders classification using artificial immune recognition system (AIRS) with performance evaluation by fuzzy resource allocation mechanism,” Expert Systems with Applications, vol. 32, no. 1, pp. 172–183, 2007. View at Publisher · View at Google Scholar · View at Scopus
  61. N. García-Pedrajas and D. Ortiz-Boyer, “Improving multiclass pattern recognition by the combination of two strategies,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 6, pp. 1001–1006, 2006. View at Publisher · View at Google Scholar · View at Scopus
  62. D. Michie and D. J. Spiegelhalter, Machine Learning, Neural and Statistical Classification, Series in Artificial Intelligence, Ellis Horwood, London, UK, 1994.