Table of Contents Author Guidelines Submit a Manuscript
Computational Intelligence and Neuroscience
Volume 2017 (2017), Article ID 3678487, 9 pages
https://doi.org/10.1155/2017/3678487
Research Article

Efficient Multiple Kernel Learning Algorithms Using Low-Rank Representation

1School of Electronic and Information Engineering, Hebei University of Technology, Tianjin 300401, China
2Key Lab of Big Data Computation of Hebei Province, Tianjin 300401, China

Correspondence should be addressed to Kewen Xia; nc.ude.tubeh@aixwk

Received 23 February 2017; Revised 20 June 2017; Accepted 5 July 2017; Published 22 August 2017

Academic Editor: Cheng-Jian Lin

Copyright © 2017 Wenjia Niu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. V. N. Vapnik, “An overview of statistical learning theory,” IEEE Transactions on Neural Networks, vol. 10, no. 5, pp. 988–999, 1999. View at Publisher · View at Google Scholar
  2. M. Hu, Y. Chen, and J. T.-Y. Kwok, “Building sparse multiple-kernel SVM classifiers,” IEEE Transactions on Neural Networks, vol. 20, no. 5, pp. 827–839, 2009. View at Publisher · View at Google Scholar · View at Scopus
  3. X. Wang, X. Liu, N. Japkowicz, and S. Matwin, “Ensemble of multiple kernel SVM classifiers,” Advances in Artificial Intelligence, vol. 8436, pp. 239–250, 2014. View at Google Scholar
  4. E. Hassan, S. Chaudhury, N. Yadav, P. Kalra, and M. Gopal, “Off-line hand written input based identity determination using multi kernel feature combination,” Pattern Recognition Letters, vol. 35, no. 1, pp. 113–119, 2014. View at Publisher · View at Google Scholar · View at Scopus
  5. F. Cai and V. Cherkassky, “Generalized SMO algorithm for SVM-based multitask learning,” IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 6, pp. 997–1003, 2012. View at Publisher · View at Google Scholar · View at Scopus
  6. K. Crammer, O. Dekel, J. Keshet, S. Shalev-Shwartz, and Y. Singer, “Online passive-aggressive algorithms,” Journal of Machine Learning Research, vol. 7, pp. 551–585, 2006. View at Google Scholar · View at MathSciNet · View at Scopus
  7. N. Cesa-Bianchi, A. Conconi, and C. Gentile, “On the generalization ability of on-line learning algorithms,” Institute of Electrical and Electronics Engineers. Transactions on Information Theory, vol. 50, no. 9, pp. 2050–2057, 2004. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  8. S. Fine and K. Scheinberg, “Efficient SVM training using low-rank kernel representations,” Journal of Machine Learning Research, vol. 2, no. 2, pp. 243–264, 2002. View at Google Scholar
  9. S. Zhou, “Sparse LSSVM in primal using cholesky factorization for large-scale problems,” IEEE Transactions on Neural Networks and Learning Systems, vol. 27, no. 4, pp. 783–795, 2016. View at Publisher · View at Google Scholar · View at MathSciNet
  10. L. Jia, S.-Z. Liao, and L.-Z. Ding, “Learning with uncertain kernel matrix set,” Journal of Computer Science and Technology, vol. 25, no. 4, pp. 709–727, 2010. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  11. G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, and Y. Ma, “Robust recovery of subspace structures by low-rank representation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 1, pp. 171–184, 2013. View at Publisher · View at Google Scholar · View at Scopus
  12. Y. Peng, A. Ganesh, J. Wright, W. Xu, and Y. Ma, “RASL: robust alignment by sparse and low-rank decomposition for linearly correlated images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 11, pp. 2233–2246, 2012. View at Publisher · View at Google Scholar · View at Scopus
  13. B. Cheng, G. Liu, J. Wang, Z. Huang, and S. Yan, “Multi-task low-rank affinity pursuit for image segmentation,” in Proceedings of the IEEE International Conference on Computer Vision (ICCV '11), pp. 2439–2446, IEEE, Barcelona, Spain, November 2011. View at Publisher · View at Google Scholar · View at Scopus
  14. Y. Mu, J. Dong, X. Yuan, and S. Yan, “Accelerated low-rank visual recovery by random projection,” in Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011, pp. 2609–2616, Colorado Springs, Colo, USA, June 2011. View at Publisher · View at Google Scholar · View at Scopus
  15. J. Chen, J. Zhou, and J. Ye, “Integrating low-rank and group-sparse structures for robust multi-task learning,” in Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD'11, pp. 42–50, San Diego, Calif, USA, August 2011. View at Publisher · View at Google Scholar · View at Scopus
  16. P. Pavlidis, J. Cai, J. Weston, and W. N. Grundy, “Gene functional classification from heterogeneous data,” in Proceedings of the 5th Annual Internatinal Conference on Computational Biology, pp. 249–255, Montreal, Canada, May 2001. View at Scopus
  17. O. Chapelle and A. Rakotomamonjy, “Second order optimization of kernel parameters,” Nips Workshop on Kernel Learning, 2008. View at Google Scholar
  18. M. Varma and B. R. Babu, “More generality in efficient multiple kernel learning,” in Proceedings of the 26th International Conference On Machine Learning, ICML 2009, pp. 1065–1072, Montreal, Canada, June 2009. View at Scopus
  19. M. Gönen and E. Alpaydin, “Localized multiple kernel learning,” in Proceedings of the the 25th international conference, pp. 352–359, Helsinki, Finland, July 2008. View at Publisher · View at Google Scholar
  20. S. Qiu and T. Lane, “A framework for multiple kernel support vector regression and its applications to siRNA efficacy prediction,” IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 6, no. 2, pp. 190–199, 2009. View at Publisher · View at Google Scholar · View at Scopus
  21. C. Cortes, M. Mohri, and A. Rostamizadeh, “Two-stage learning kernel algorithms,” in Proceedings of the 27th International Conference on Machine Learning, ICML 2010, pp. 239–246, Haifa, Israel, June 2010. View at Scopus
  22. C. Cortes, M. Mohri, and A. Rostamizadeh, “Learning non-linear combinations of kernels,” in Proceedings of the 23rd Annual Conference on Neural Information Processing Systems (NIPS '09), pp. 396–404, December 2009. View at Scopus
  23. Z. Xu, R. Jin, H. Yang, I. King, and M. R. Lyu, “Simple and efficient multiple kernel learning by group lasso,” in Proceedings of the 27th International Conference on Machine Learning, ICML 2010, pp. 1175–1182, Haifa, Israel, June 2010. View at Scopus
  24. M. Kloft, U. Brefeld, S. Sonnenburg, and A. Zien, “Non-sparse regularization and efficient training with multiple kernels. Arxiv Preprint abs/1003,” https://arxiv.org/abs/1003.0079.
  25. M. Gönen and E. Alpaydın, “Multiple kernel learning algorithms,” Journal of Machine Learning Research, vol. 12, pp. 2211–2268, 2011. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  26. F. R. Bach, “Consistency of the group lasso and multiple kernel learning,” Journal of Machine Learning Research, vol. 9, no. 2, pp. 1179–1225, 2008. View at Google Scholar · View at MathSciNet
  27. E. J. Candes, X. Li, Y. Ma, and J. Wright, “Robust principal component analysis?” Journal of the ACM, vol. 58, no. 3, 2011. View at Publisher · View at Google Scholar · View at MathSciNet
  28. C.-F. Chen, C.-P. Wei, and Y.-C. F. Wang, “Low-rank matrix recovery with structural incoherence for robust face recognition,” in Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2012, pp. 2618–2625, Providence, RI, USA, June 2012. View at Publisher · View at Google Scholar · View at Scopus
  29. J.-F. Cai, E. J. Candes, and Z. Shen, “A singular value thresholding algorithm for matrix completion,” SIAM Journal on Optimization, vol. 20, no. 4, pp. 1956–1982, 2010. View at Publisher · View at Google Scholar · View at MathSciNet
  30. L. Zhuang, H. Gao, Z. Lin, Y. Ma, X. Zhang, and N. Yu, “Non-negative low rank and sparse graph for semi-supervised learning,” in Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2012, pp. 2328–2335, usa, June 2012. View at Publisher · View at Google Scholar · View at Scopus
  31. C. Chang and C. Lin, “LIBSVM: a Library for support vector machines,” ACM Transactions on Intelligent Systems and Technology, vol. 2, no. 3, article 27, 2011. View at Publisher · View at Google Scholar · View at Scopus
  32. A. Tsanas, M. A. Little, C. Fox, and L. O. Ramig, “Objective automatic assessment of rehabilitative speech treatment in parkinson's disease,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 22, no. 1, pp. 181–190, 2014. View at Publisher · View at Google Scholar