Table of Contents Author Guidelines Submit a Manuscript
Complexity
Volume 2018 (2018), Article ID 3241489, 14 pages
https://doi.org/10.1155/2018/3241489
Research Article

Effective Evolutionary Multilabel Feature Selection under a Budget Constraint

School of Computer Science and Engineering, Chung-Ang University, 221 Heukseok-dong, Dongjak-gu, Seoul 06974, Republic of Korea

Correspondence should be addressed to Dae-Won Kim; rk.ca.uac@mikwd

Received 29 September 2017; Accepted 21 January 2018; Published 7 March 2018

Academic Editor: Kevin Wong

Copyright © 2018 Jaesung Lee et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. A. Iliopoulos, R. Shirzadeh, W. Weijtjens, P. Guillaume, D. V. Hemelrijck, and C. Devriendt, “A modal decomposition and expansion approach for prediction of dynamic responses on a monopile offshore wind turbine using a limited number of vibration sensors,” Mechanical Systems and Signal Processing, vol. 68-69, pp. 84–104, 2016. View at Publisher · View at Google Scholar · View at Scopus
  2. S. Diplaris, G. Tsoumakas, P. A. Mitkas, and I. Vlahavas, “Protein classification with multiple algorithms,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics): Preface, vol. 3746, pp. 448–456, 2005. View at Publisher · View at Google Scholar · View at Scopus
  3. Y. Rao, “Contextual Sentiment Topic Model for Adaptive Social Emotion Classification,” IEEE Intelligent Systems, vol. 31, no. 1, pp. 41–47, 2016. View at Publisher · View at Google Scholar · View at Scopus
  4. R. Agrawal, A. Gupta, Y. Prabhu, and M. Varma, “Multi-label learning with millions of labels,” in Proceedings of the the 22nd international conference, pp. 13–24, Rio de Janeiro, Brazil, May 2013. View at Publisher · View at Google Scholar
  5. P. Duygulu, K. Barnard, J. F. de Freitas, and D. A. Forsyth, “Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary,” in Computer Vision — ECCV 2002, vol. 2353 of Lecture Notes in Computer Science, pp. 97–112, Springer Berlin Heidelberg, Berlin, Heidelberg, 2002. View at Publisher · View at Google Scholar
  6. H. Ghasemzadeh, N. Amini, R. Saeedi, and M. Sarrafzadeh, “Power-aware computing in wearable sensor networks: An optimal feature selection,” IEEE Transactions on Mobile Computing, vol. 14, no. 4, pp. 800–812, 2015. View at Publisher · View at Google Scholar · View at Scopus
  7. B. Nushi, A. Singla, A. Krause, and D. Kossmann, “Learning and feature selection under budget constraints in crowdsourcing,” in Proceedings of the in 4th AAAI Conf. Human Computation and Crowdsourcing, pp. 159–168, Austin, USA, October 2016.
  8. H. Yang, R. Fujimaki, Y. Kusumura, and J. Liu, “Online feature selection: A limited-memory substitution algorithm and its asynchronous parallel variation,” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2016, pp. 1945–1954, USA, August 2016. View at Publisher · View at Google Scholar · View at Scopus
  9. H. Blume, B. Bischl, M. Botteck et al., “Huge music archives on mobile devices,” IEEE Signal Processing Magazine, vol. 28, no. 4, pp. 24–39, 2011. View at Publisher · View at Google Scholar · View at Scopus
  10. P. Naula, A. Airola, T. Salakoski, and T. Pahikkala, “Multi-label learning under feature extraction budgets,” Pattern Recognition Letters, vol. 40, no. 1, pp. 56–65, 2014. View at Publisher · View at Google Scholar · View at Scopus
  11. J. Lee and D. W. Kim, “Memetic feature selection algorithm for multi-label classification,” Information Sciences, vol. 293, pp. 80–96, 2015. View at Publisher · View at Google Scholar
  12. M.-L. Zhang, J. M. Peña, and V. Robles, “Feature selection for multi-label naive Bayes classification,” Information Sciences, vol. 179, no. 19, pp. 3218–3229, 2009. View at Publisher · View at Google Scholar · View at Scopus
  13. H. Yang, Z. Xu, M. R. Lyu, and I. King, “Budget constrained non-monotonic feature selection,” Neural Networks, vol. 71, pp. 214–224, 2015. View at Publisher · View at Google Scholar · View at Scopus
  14. F. Min and J. Xu, “Semi-greedy heuristics for feature selection with test cost constraints,” Granular Computing, vol. 1, no. 3, pp. 199–211, 2016. View at Publisher · View at Google Scholar
  15. J. Wang, P. Zhao, S. C. H. Hoi, and R. Jin, “Online feature selection and its applications,” IEEE Transactions on Knowledge and Data Engineering, vol. 26, no. 3, pp. 698–710, 2014. View at Publisher · View at Google Scholar · View at Scopus
  16. J. Lee and D.-W. Kim, “SCLS: Multi-label feature selection based on scalable criterion for large label set,” Pattern Recognition, vol. 66, pp. 342–352, 2017. View at Publisher · View at Google Scholar · View at Scopus
  17. J. Lee, H. Lim, and D.-W. Kim, “Approximating mutual information for multi-label feature selection,” IEEE Electronics Letters, vol. 48, no. 15, pp. 929-930, 2012. View at Publisher · View at Google Scholar · View at Scopus
  18. H. Lim, J. Lee, and D.-W. Kim, “Multi-label learning using mathematical programming,” IEICE Transaction on Information and Systems, vol. E98D, no. 1, pp. 197–200, 2015. View at Publisher · View at Google Scholar · View at Scopus
  19. Y. Lin, Q. Hu, J. Liu, and J. Duan, “Multi-label feature selection based on max-dependency and min-redundancy,” Neurocomputing, vol. 168, pp. 92–103, 2015. View at Publisher · View at Google Scholar · View at Scopus
  20. G. Doquire and M. Verleysen, “Mutual information-based feature selection for multilabel classification,” Neurocomputing, vol. 122, pp. 148–155, 2013. View at Publisher · View at Google Scholar · View at Scopus
  21. D. Kong, C. Ding, H. Huang, and H. Zhao, “Multi-label ReliefF and F-statistic feature selections for image annotation,” in Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2012, pp. 2352–2359, usa, June 2012. View at Publisher · View at Google Scholar · View at Scopus
  22. J. Lee and D.-W. Kim, “Fast multi-label feature selection based on information-theoretic feature ranking,” Pattern Recognition, vol. 48, no. 9, pp. 2761–2771, 2015. View at Publisher · View at Google Scholar · View at Scopus
  23. X. Kong and P. S. Yu, “GMLC: A multi-label feature selection framework for graph classification,” Knowledge and Information Systems, vol. 31, no. 2, pp. 281–305, 2012. View at Publisher · View at Google Scholar · View at Scopus
  24. J. Lee and D.-W. Kim, “Feature selection for multi-label classification using multivariate mutual information,” Pattern Recognition Letters, vol. 34, no. 3, pp. 349–357, 2013. View at Publisher · View at Google Scholar · View at Scopus
  25. N. Spolaôr, E. A. Cherman, M. C. Monard, and H. D. Lee, “A comparison of multi-label feature selection methods using the problem transformation approach,” Electronic Notes in Theoretical Computer Science, vol. 292, pp. 135–151, 2013. View at Publisher · View at Google Scholar · View at Scopus
  26. Q. Gu, Z. Li, and J. Han, “Correlated multi-label feature selection,” in Proceedings of the the 20th ACM international conference, p. 1087, Glasgow, Scotland, UK, October 2011. View at Publisher · View at Google Scholar
  27. B. Qian and I. Davidson, “Semi-supervised dimension reduction for multi-label classification,” in Proceedings of the Proc. 24th AAAI Conf. Artificial Intelligence, pp. 569–574, Atlanta, USA, Jul 2010.
  28. B. Xue, M. Zhang, W. N. Browne, and X. Yao, “A Survey on Evolutionary Computation Approaches to Feature Selection,” IEEE Transactions on Evolutionary Computation, vol. 20, no. 4, pp. 606–626, 2016. View at Publisher · View at Google Scholar · View at Scopus
  29. Y. Zhang, D. Gong, Y. Hu, and W. Zhang, “Feature selection algorithm based on bare bones particle swarm optimization,” Neurocomputing, vol. 148, pp. 150–157, 2015. View at Publisher · View at Google Scholar
  30. Y. Zhang, D.-W. Gong, and J. Cheng, “Multi-objective particle swarm optimization approach for cost-based feature selection in classification,” IEEE Transactions on Computational Biology and Bioinformatics, vol. 14, no. 1, pp. 64–75, 2017. View at Publisher · View at Google Scholar · View at Scopus
  31. Y. Zhang, X.-F. Song, and D.-W. Gong, “A return-cost-based binary firefly algorithm for feature selection,” Information Sciences, vol. 418-419, pp. 561–574, 2017. View at Publisher · View at Google Scholar · View at Scopus
  32. J. Read, B. Pfahringer, and G. Holmes, “Multi-label Classification Using Ensembles of Pruned Sets,” in Proceedings of the 2008 Eighth IEEE International Conference on Data Mining (ICDM), pp. 995–1000, Pisa, Italy, December 2008. View at Publisher · View at Google Scholar
  33. N. Spolaôr, M. C. Monard, G. Tsoumakas, and H. D. Lee, “A systematic review of multi-label feature selection and a new method based on label construction,” Neurocomputing, vol. 180, pp. 3–15, 2016. View at Publisher · View at Google Scholar · View at Scopus
  34. Y. Sun, A. K. C. Wong, and M. S. Kamel, “Classification of imbalanced data: a review,” International Journal of Pattern Recognition and Artificial Intelligence, vol. 23, no. 4, pp. 687–719, 2009. View at Publisher · View at Google Scholar · View at Scopus
  35. G. Tsoumakas, I. Katakis, and I. Vlahavas, “Random k-labelsets for multilabel classification,” IEEE Transactions on Knowledge and Data Engineering, vol. 23, no. 7, pp. 1079–1089, 2011. View at Publisher · View at Google Scholar · View at Scopus
  36. S. Ji and J. Ye, “Linear dimensionality reduction for multi-label classification,” in Proceedings of the Proc. 21th Int. Joint Conf. Artificial Intelligence, pp. 1077–1082, Pasadena, USA, Jul 2009.
  37. F. Nie, H. Huang, X. Cai, and C. H. Ding, “Efficient and robust feature selection via joint l2,1-norms minimization,” in Advances in Neural Information Processing System, pp. 1813–1821, MIT Press, 2010. View at Google Scholar
  38. J. Lee and D.-W. Kim, “Mutual Information-based multi-label feature selection using interaction information,” Expert Systems with Applications, vol. 42, no. 4, pp. 2013–2025, 2015. View at Publisher · View at Google Scholar · View at Scopus
  39. M.-L. Zhang and Z.-H. Zhou, “A review on multi-label learning algorithms,” IEEE Transactions on Knowledge and Data Engineering, vol. 26, no. 8, pp. 1819–1837, 2014. View at Publisher · View at Google Scholar · View at Scopus
  40. Z. Zhu, S. Jia, and Z. Ji, “Towards a memetic feature selection paradigm,” IEEE Computational Intelligence Magazine, vol. 5, no. 2, pp. 41–53, 2010. View at Publisher · View at Google Scholar · View at Scopus
  41. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, “A fast and elitist multiobjective genetic algorithm: NSGA-II,” IEEE Transactions on Evolutionary Computation, vol. 6, no. 2, pp. 182–197, 2002. View at Publisher · View at Google Scholar · View at Scopus
  42. J. Yin, T. Tao, and J. Xu, “A Multi-label feature selection algorithm based on multi-objective optimization,” in Proceedings of the International Joint Conference on Neural Networks, IJCNN 2015, Ireland, July 2015. View at Publisher · View at Google Scholar · View at Scopus
  43. Y. Zhang, D.-W. Gong, X.-Y. Sun, and Y.-N. Guo, “A PSO-based multi-objective multi-label feature selection method in classification,” Scientific Reports, vol. 7, no. 1, article no. 376, 2017. View at Publisher · View at Google Scholar · View at Scopus
  44. G. Karafotias, M. Hoogendoorn, and A. E. Eiben, “Parameter Control in Evolutionary Algorithms: Trends and Challenges,” IEEE Transactions on Evolutionary Computation, vol. 19, no. 2, pp. 167–187, 2015. View at Publisher · View at Google Scholar · View at Scopus
  45. M.-L. Zhang and L. Wu, “LIFT: multi-label learning with label-specific features,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, no. 1, pp. 107–120, 2015. View at Publisher · View at Google Scholar · View at Scopus
  46. Y. Yang and S. Gopal, “Multilabel classification with meta-level features in a learning-to-rank framework,” Machine Learning, vol. 88, no. 1-2, pp. 47–68, 2012. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  47. A. Cano, J. M. Luna, E. L. Gibaja, and S. Ventura, “LAIM discretization for multi-label data,” Information Sciences, vol. 330, pp. 370–384, 2016. View at Publisher · View at Google Scholar · View at Scopus
  48. F. van den Bergh and A. P. Engelbrecht, “A study of particle swarm optimization particle trajectories,” Information Sciences, vol. 176, no. 8, pp. 937–971, 2006. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  49. S. Arlot and A. Celisse, “A survey of cross-validation procedures for model selection,” Statistics Surveys, vol. 4, pp. 40–79, 2010. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  50. J. Lee, H. Kim, N.-R. Kim, and J.-H. Lee, “An approach for multi-label classification by directed acyclic graph with label correlation maximization,” Information Sciences, vol. 351, pp. 101–114, 2016. View at Publisher · View at Google Scholar · View at Scopus
  51. F. Wilcoxon, “Probability tables for individual comparisons by ranking methods,” Biometrics - A Journal of the International Biometric Society, vol. 3, pp. 119–122, 1947. View at Google Scholar · View at MathSciNet · View at Scopus