Table of Contents Author Guidelines Submit a Manuscript
The Scientific World Journal
Volume 2013, Article ID 982438, 13 pages
http://dx.doi.org/10.1155/2013/982438
Research Article

Hybrid Model Based on Genetic Algorithms and SVM Applied to Variable Selection within Fruit Juice Classification

1Information and Communications Technologies Department, Faculty of Computer Science, University of A Coruña, Campus Elviña s/n, 15071, A Coruña, Spain
2Analytical Chemistry Department, Faculty of Sciences, University of A Coruña, Campus da Zapateira s/n, 15008, A Coruña, Spain

Received 24 September 2013; Accepted 21 October 2013

Academic Editors: Z. Cui and X. Yang

Copyright © 2013 C. Fernandez-Lozano et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. I. Guyon, A. Elisseefi, and L. P. Kaelbling, “An introduction to variable and feature selection,” Journal of Machine Learning Research, vol. 3, pp. 1157–1182, 2003. View at Google Scholar
  2. P. Lewis, “The characteristic selection problem in recognition systems,” IRE Transactions on Information Theory, vol. 8, pp. 171–178, 1962. View at Google Scholar
  3. G. S. Sebestyen, Decision-Making Processes in Pattern Recognition, ACM Monograph Series, 1962.
  4. Y. Saeys, I. Inza, and P. Larrañaga, “A review of feature selection techniques in bioinformatics,” Bioinformatics, vol. 23, no. 19, pp. 2507–2517, 2007. View at Publisher · View at Google Scholar · View at Scopus
  5. F. Alonso-Atienza, J. L. Rojo-Álvarez, A. Rosado-Muñoz, J. J. Vinagre, A. García-Alberola, and G. Camps-Valls, “Feature selection using support vector machines and bootstrap methods for ventricular fibrillation detection,” Expert Systems with Applications, vol. 39, no. 2, pp. 1956–1967, 2012. View at Publisher · View at Google Scholar · View at Scopus
  6. C. Fernandez-Lozano, J. A. Seoane, M. Gestal Pose, T. R. Gaunt, and C. Campbell, “Texture classification using kernel-based techniques,” in International Work Conference on Artificial Neural Network, G. J. Ignacio Rojas and J. Cabestany, Eds., pp. 427–434, Springer, Puerto de la Cruz, Spain, 2013.
  7. I. T. Jolliffe, Principal Component Analysis, Springer, New York, NY, USA, 2 edition, 2002.
  8. M. Barker and W. Rayens, “Partial least squares for discrimination,” Journal of Chemometrics, vol. 17, no. 3, pp. 166–173, 2003. View at Publisher · View at Google Scholar · View at Scopus
  9. R. Rosipal and N. Krämer, “Overview and recent advances in partial least squares,” in Proceedings of the International Conference on Subspace, Latent Structure and Feature Selection, pp. 34–51, Springer, Bohinj, Slovenia, 2006.
  10. Z. Ramadan, D. Jacobs, M. Grigorov, and S. Kochhar, “Metabolic profiling using principal component analysis, discriminant partial least squares, and genetic algorithms,” Talanta, vol. 68, no. 5, pp. 1683–1691, 2006. View at Publisher · View at Google Scholar · View at Scopus
  11. F. Tan, X. Feng, Z. Fang, M. Li, Y. Guo, and L. Jiang, “Prediction of mitochondrial proteins based on genetic algorithm—partial least squares and support vector machine,” Amino Acids, vol. 33, no. 4, pp. 669–675, 2007. View at Publisher · View at Google Scholar · View at Scopus
  12. J. A. Freeman and D. M. Skapura, Neural Networks: Algorithms, Applications, and Programming Techniques, Addison-Wesley, Reading, Mass, USA, 1991.
  13. M. Gestal, M. P. Gómez-Carracedo, J. M. Andrade et al., “Selection of variables by genetic algorithms to classify apple beverages by artificial neural networks,” Applied Artificial Intelligence, vol. 19, no. 2, pp. 181–198, 2005. View at Publisher · View at Google Scholar · View at Scopus
  14. C. M. Bishop, Neural Networks For Pattern Recognition, Oxford university press, New York, NY, USA, 1995.
  15. C. Fernandez-Lozano, J. A. Seoane, P. Mesejo, Y. S. G. Nashed, S. Cagnoni, and J. Dorado, “2D-PAGE Texture classification using support vector machines and genetic algorithms,” in Proceedings of the 4th International Conference on Bioinformatics Models, Methods and Algorithms, pp. 5–14, Scitepress, 2013.
  16. C. Fernandez-Lozano, J. A. Seoane, M. Gestal Pose, D. Rivero, J. Dorado, and A. Pazos, “A texture-based classification method for proteins in two-dimensional electrophoresis gel images,” in Proceedings of the International Conference on Computer Vision Theory and Applications VISSAP, pp. 401–404, Scitepress, Barcelona, Spain, 2013.
  17. M. P. Gómez-Carracedo, M. Gestal, J. Dorado, and J. M. Andrade, “Chemically driven variable selection by focused multimodal genetic algorithms in mid-IR spectra,” Analytical and Bioanalytical Chemistry, vol. 389, no. 7-8, pp. 2331–2342, 2007. View at Publisher · View at Google Scholar · View at Scopus
  18. K.-Y. Chen and C.-H. Wang, “Support vector regression with genetic algorithms in forecasting tourism demand,” Tourism Management, vol. 28, no. 1, pp. 215–226, 2007. View at Publisher · View at Google Scholar · View at Scopus
  19. P.-F. Pai and W.-C. Hong, “Forecasting regional electricity load based on recurrent support vector machines with genetic algorithms,” Electric Power Systems Research, vol. 74, no. 3, pp. 417–425, 2005. View at Publisher · View at Google Scholar · View at Scopus
  20. K. K. Kandaswamy, G. Pugalenthi, S. Möller et al., “Prediction of apoptosis protein locations with genetic algorithms and support vector machines through a new mode of pseudo amino acid composition,” Protein and Peptide Letters, vol. 17, no. 12, pp. 1473–1479, 2010. View at Google Scholar · View at Scopus
  21. D.-K. Kang and M.-J. Kim, “Performance enhancement of SVM ensembles using genetic algorithms in bankruptcy prediction,” in Proceedings of the 3rd International Conference on Advanced Computer Theory and Engineering (ICACTE '10), pp. V2154–V2158, August 2010. View at Publisher · View at Google Scholar · View at Scopus
  22. X. Chen and L. Wu, “Nonlinear demodulation and channel coding in EBPSK scheme,” The Scientific World Journal, vol. 2012, Article ID 180469, 7 pages, 2012. View at Publisher · View at Google Scholar
  23. Y. F. Huang and S. Y. Chen, “Extracting physicochemical features to predict protein secondary structure,” The Scientific World Journal, vol. 2013, Article ID 347106, 8 pages, 2013. View at Publisher · View at Google Scholar
  24. V. Vapnik, The Nature of Statistical Learning Theory, Springer, New York, NY, USA, 1995.
  25. V. N. Vapnik, Statistical Learning Theory, John Wiley & Sons, Chichester, UK, 1998.
  26. S.-H. Min, J. Lee, and I. Han, “Hybrid genetic algorithms and support vector machines for bankruptcy prediction,” Expert Systems with Applications, vol. 31, no. 3, pp. 652–660, 2006. View at Publisher · View at Google Scholar · View at Scopus
  27. C.-H. Wu, G.-H. Tzeng, Y.-J. Goo, and W.-C. Fang, “A real-valued genetic algorithm to optimize the parameters of support vector machine for predicting bankruptcy,” Expert Systems with Applications, vol. 32, no. 2, pp. 397–408, 2007. View at Publisher · View at Google Scholar · View at Scopus
  28. J. A. K. Suykens and J. Vandewalle, “Least squares support vector machine classifiers,” Neural Processing Letters, vol. 9, no. 3, pp. 293–300, 1999. View at Google Scholar · View at Scopus
  29. E. Huerta, B. Duval, and J. K. Hao, “A hybrid GA/SVM approach for gene selection and classification of microarray data,” in Applications of Evolutionary Computing, F. Rothlauf, J. Branke, S. Cagnoni et al., Eds., pp. 34–44, Springer, Berlin, Germany, 2006. View at Google Scholar
  30. R. Venegas, “Academic text classification based on lexical-semantic content,” Revista Signos, vol. 40, no. 63, pp. 239–271, 2007. View at Google Scholar · View at Scopus
  31. C. A. Donís, E. Valencia Morales, and C. Morell Pérez, “Support vector machine model for regression applied to the estimation of the creep ruptura stress in ferritic steels,” Revista Facultad de Ingenieri'a Universidad de Antioquia, no. 47, pp. 53–58, 2009. View at Google Scholar
  32. L. Pérez, J. Mora, and J. Bedoya, “A linear approach to determining an SVM-based fault locator's optimal parameters,” Ingeniería e Investigación, vol. 29, pp. 76–81, 2009. View at Google Scholar
  33. M. Tong, K. H. Liu, C. Xu, and W. Ju, “An ensemble of SVM classifiers based on gene pairs,” Computers in Biology and Medicine, vol. 43, pp. 729–737, 2013. View at Google Scholar
  34. Z. Wang, Y. H. Shao, and T. R. Wu, “A GA-based model selection for smooth twin parametric-margin support vector machine,” Pattern Recognition, vol. 46, pp. 2267–2277, 2013. View at Google Scholar
  35. K. J. Won, C. Saunders, and A. Prügel-Bennett, “Evolving fisher kernels for biological sequence classification,” Evolutionary Computation, vol. 21, pp. 83–105, 2013. View at Google Scholar
  36. J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proceedings of the IEEE International Conference on Neural Networks, pp. 1942–1948, December 1995. View at Scopus
  37. T. Ilhan and G. Tezel, “A genetic algorithm-support vector machine method with parameter optimization for selecting the tag SNPs,” Journal of Biomedical Informatics, vol. 46, pp. 328–340, 2013. View at Google Scholar
  38. R. J. Ma, N. Y. Yu, and J. Y. Hu, “Application of particle swarm optimization algorithm in the heating system planning problem,” The Scientific World Journal, vol. 2013, Article ID 718345, 11 pages, 2013. View at Google Scholar
  39. Y. Zhang, S. Wang, G. Ji, and Z. Dong, “An MR brain images classifier system via particle swarm optimization and kernel support vector machine,” The Scientific World Journal, vol. 2013, Article ID 130134, 9 pages, 2013. View at Publisher · View at Google Scholar
  40. H. Ocak, “A medical decision support system based on support vector machines and the genetic algorithm for the evaluation of fetal well-being,” Journal of Medical Systems, vol. 37, aricle 9913, 2013. View at Google Scholar
  41. M. S. Uzer, N. Yilmaz, and O. Inan, “Feature selection method based on artificial bee colony algorithm and support vector machines for medical datasets classification,” The Scientific World Journal, vol. 2013, Article ID 419187, 10 pages, 2013. View at Publisher · View at Google Scholar
  42. L. Li, H. Chen, C. Liu et al., “A robust hybrid approach based on estimation of distribution algorithm and support vector machine for hunting candidate disease genes,” The Scientific World Journal, vol. 2013, Article ID 393570, 7 pages, 2013. View at Publisher · View at Google Scholar
  43. M. Burton, M. Thomassen, Q. Tan, and T. A. Kruse, “Gene expression profiles for predicting metastasis in breast cancer: a cross-study comparison of classification methods,” The Scientific World Journal, vol. 2012, Article ID 380495, 11 pages, 2012. View at Publisher · View at Google Scholar
  44. M. P. Poland, C. D. Nugent, H. Wang, and L. Chen, “Genetic algorithm and pure random search for exosensor distribution optimisation,” International Journal of Bio-Inspired Computation, vol. 4, pp. 359–372, 2012. View at Google Scholar
  45. J. Muñuzuri, P. Cortés Achedad, M. Rodríguez, and R. Grosso, “Use of a genetic algorithm for building efficient choice designs,” International Journal of Bio-Inspired Computation, vol. 4, pp. 27–32, 2012. View at Google Scholar
  46. D. Koller and M. Sahami, “Toward optimal feature selection,” in Citeseer, pp. 284–292, 1996. View at Google Scholar
  47. R. Kohavi and G. H. John, “Wrappers for feature subset selection,” Artificial Intelligence, vol. 97, no. 1-2, pp. 273–324, 1997. View at Google Scholar · View at Scopus
  48. J. H. Holland, Adaptation in Natural and Artificial Systems, 1975.
  49. D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley, Reading, Mass, USA, 1989.
  50. S. S. Haykin, Neural Networks: A Comprehensive Foundation, Prentice Hall, New York, NY, USA, 1999.
  51. J. H. Holland, Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence, University of Michigan Press, 1975.
  52. W. Siedlecki and J. Sklansky, “A note on genetic algorithms for large-scale feature selection,” Pattern Recognition Letters, vol. 10, no. 5, pp. 335–347, 1989. View at Google Scholar · View at Scopus
  53. M. Kudo and J. Sklansky, “A comparative evaluation of medium- and large-scale feature selectors for pattern classifiers,” Kybernetika, vol. 34, no. 4, pp. 429–434, 1998. View at Google Scholar · View at Scopus
  54. J. R. Koza, F. H. Bennett, D. Andre, and M. A. Keane, “Genetic programming III: darwinian invention and problem solving [book review],” IEEE Transactions on Evolutionary Computation, vol. 3, pp. 251–253, 1999. View at Google Scholar
  55. A. M. Turing, “Computing machinery and intelligence,” Mind, vol. 59, pp. 433–460, 1950. View at Google Scholar
  56. A. Samuel, “Some studies in machine learning using the game of checkers,” IBM Journal of Research and Development, vol. 11, pp. 601–617, 1967. View at Google Scholar
  57. M. Mitchell, An Introduction to Genetic Algorithms, The MIT press, 1998.
  58. D. E. Goldberg and K. Deb, “A comparative analysis of selection schemes used in genetic algorithms,” Urbana, vol. 51, pp. 61801–62996, 1991. View at Google Scholar
  59. D. E. Goldberg and J. Richardson, “Genetic algorithms with sharing for multimodal function optimization,” in in Proceedings of the 2nd International Conference on Genetic Algorithms on Genetic Algorithms and their Application, pp. 41–49, L. Erlbaum Associates, 1987.
  60. K. Deb, “Multi-objective genetic algorithms: problem difficulties and construction of test problems,” Evolutionary computation, vol. 7, no. 3, pp. 205–230, 1999. View at Google Scholar · View at Scopus
  61. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee, “Choosing multiple parameters for support vector machines,” Machine Learning, vol. 46, no. 1–3, pp. 131–159, 2002. View at Publisher · View at Google Scholar · View at Scopus
  62. B. Schölkopf and A. J. Smola, Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, The MIT Press, Cambridge, Mass, USA, 2002.
  63. V. Vapnik and A. Chervonenkis, “The necessary and sufficient conditions for consistency in the empirical risk minimization method,” Pattern Recognition and Image Analysis, vol. 1, pp. 283–305, 1991. View at Google Scholar
  64. M. Wall, “GAlib: a C++ library of genetic algorithm components,” Mechanical Engineering Department, Massachusetts Institute of Technology, 1996, http://lancet.mit.edu/ga/.
  65. M. Sewell, “WinSVM: a windows implementation of a support vector machine,” 2005, http://winsvm.martinsewell.com/.
  66. U. Maulik and S. Bandyopadhyay, “Fuzzy partitioning using a real-coded variable-length genetic algorithm for pixel classification,” IEEE Transactions on Geoscience and Remote Sensing, vol. 41, no. 5, pp. 1075–1081, 2003. View at Publisher · View at Google Scholar · View at Scopus
  67. M. Gestal, A. Cancela, J. Andrade, and M. Gomez-Carracedo, “Several approaches to variable selection by means of genetic algorithms,” in Intelligent Information Technologies: Concepts, Methodologies, Tools and Applications, V. Sugaraman, Ed., Information Science Reference, pp. 274–292, Hershey, New York, NY, USA, 2007. View at Google Scholar
  68. M. Gestal, M. P. Gómez-Carracedo, J. M. Andrade et al., “Classification of apple beverages using artificial neural networks with previous variable selection,” Analytica Chimica Acta, vol. 524, no. 1-2, pp. 225–234, 2004. View at Publisher · View at Google Scholar · View at Scopus
  69. D. R. Heldman and D. B. Lund, Handbook of Food Engineering, CRC Press, New York, NY, USA, 2007.
  70. W. J. Krzanowski, Principles of Multivariate Analysis: A User's Perspective, Oxford University Press, New York, NY, USA, 2000.
  71. M. P. Gómez-Carracedo, M. Gestal, J. Dorado, and J. M. Andrade, “Linking chemical knowledge and genetic algorithms using two populations and focused multimodal search,” Chemometrics and Intelligent Laboratory Systems, vol. 87, no. 2, pp. 173–184, 2007. View at Publisher · View at Google Scholar · View at Scopus