Table of Contents Author Guidelines Submit a Manuscript
Complexity
Volume 2017, Article ID 2691474, 14 pages
https://doi.org/10.1155/2017/2691474
Research Article

Kernel Negative ε Dragging Linear Regression for Pattern Classification

Yali Peng,1,2,3 Lu Zhang,1,2 Shigang Liu,1,2,3 Xili Wang,1,2 and Min Guo2,3

1Key Laboratory of Modern Teaching Technology, Ministry of Education, Xi’an 710062, China
2Engineering Laboratory of Teaching Information Technology of Shaanxi Province, Xi’an 710119, China
3School of Computer Science, Shaanxi Normal University, Xi’an 710119, China

Correspondence should be addressed to Shigang Liu; nc.ude.unns@uilghs

Received 27 August 2017; Accepted 9 November 2017; Published 10 December 2017

Academic Editor: Chuan Zhou

Copyright © 2017 Yali Peng et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. T. Strutz, Data fitting and uncertainty: a practical introduction to weighted least squares and beyond, Vieweg, Wiesbaden, Germany, 2010. View at Publisher · View at Google Scholar
  2. S. Wold, A. Ruhe, H. Wold, and W. J. Dunn III, “The collinearity problem in linear regression. The Partial Least Squares (PLS) approach to generalized inverses,” SIAM Journal on Scientific and Statistical Computing, vol. 5, no. 3, pp. 735–743, 1984. View at Publisher · View at Google Scholar
  3. Y. Li and A. Ngom, “Nonnegative least-squares methods for the classification of high-dimensional biological data,” IEEE Transactions on Computational Biology and Bioinformatics, vol. 10, no. 2, pp. 447–456, 2013. View at Publisher · View at Google Scholar · View at Scopus
  4. Y. Xu, X. Fang, Q. Zhu, Y. Chen, J. You, and H. Liu, “Modified minimum squared error algorithm for robust classification and face recognition experiments,” Neurocomputing, vol. 135, pp. 253–261, 2014. View at Publisher · View at Google Scholar · View at Scopus
  5. C. Zhou, W. Lu, P. Zhang, J. Wu, Y. Hu, and L. Guo, “On the minimum differentially resolving set problem for diffusion source inference in networks,” in Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, pp. 79–85, 2016.
  6. C. Xu, D. Tao, Y. Li, and C. Xu, “Large-margin multi-view Gaussian process,” Multimedia Systems, vol. 21, no. 2, pp. 147–157, 2014. View at Publisher · View at Google Scholar · View at Scopus
  7. U. Brefeld, T. Gärtner, T. Scheffer, and S. Wrobel, “Efficient co-regularised least squares regression,” in Proceedings of the Twenty-Third International Conference (ICML 2006), pp. 137–144, Carnegie Mellon University, Pittsburgh, USA, June 2006. View at Scopus
  8. B. Du, M. Zhang, L. Zhang, R. Hu, and D. Tao, “PLTD: Patch-Based Low-Rank Tensor Decomposition for Hyperspectral Images,” IEEE Transactions on Multimedia, vol. 19, no. 1, pp. 67–79, 2017. View at Publisher · View at Google Scholar · View at Scopus
  9. T. Liu, M. Gong, and D. Tao, “Large-Cone Nonnegative Matrix Factorization,” IEEE Transactions on Neural Networks and Learning Systems, 2016. View at Publisher · View at Google Scholar · View at Scopus
  10. C. Liu, C. Zhou, J. Wu, H. Xie, Y. Hu, and L. Guo, “CPMF: A collective pairwise matrix factorization model for upcoming event recommendation,” in Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), pp. 1532–1539, Anchorage, AK, USA, May 2017. View at Publisher · View at Google Scholar
  11. S. M. Xiang, F. P. Nie, and C. S. Zhang, “Regression reformulations of LLE and LTSA with locally linear transformation,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 41, no. 5, pp. 1250–1262, 2011. View at Publisher · View at Google Scholar
  12. F. P. Nie, H. Wang, H. Huang, and C. Ding, “Adaptive loss minimization for semi-supervised elastic embedding,” in Proceedings of the in proceedings of the twenty-third international joint conference on artificial intelligence, 2013.
  13. X. Z. Fang, Y. Xu, X. Li, Z. Lai, and W. K. Wong, “Learning a nonnegative sparse graph for linear regression,” IEEE Transactions on Image Processing, vol. 24, no. 9, pp. 2760–2771, 2015. View at Publisher · View at Google Scholar · View at MathSciNet
  14. S. Liu, L. Li, Y. Peng, G. Qiu, and T. Lei, “Improved sparse representation method for image classification,” IET Computer Vision, vol. 11, no. 4, pp. 319–330, 2017. View at Publisher · View at Google Scholar
  15. T. Strutz, Data Fitting and Uncertainty, Vieweg, Wiesbaden, Germany, 2010. View at Publisher · View at Google Scholar
  16. B. Du and L. Zhang, “A discriminative metric learning based anomaly detection method,” IEEE Transactions on Geoscience and Remote Sensing, vol. 52, no. 11, pp. 6844–6857, 2014. View at Publisher · View at Google Scholar · View at Scopus
  17. T. Liu and D. Tao, “On the performance of Manhattan nonnegative matrix factorization,” IEEE Transactions on Neural Networks and Learning Systems, vol. 27, no. 9, pp. 1851–1863, 2016. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  18. B. Du, W. Xiong, J. Wu, L. Zhang, L. Zhang, and D. Tao, “Stacked Convolutional Denoising Auto-Encoders for Feature Representation,” IEEE Transactions on Cybernetics, vol. 47, no. 4, pp. 1017–1027, 2017. View at Publisher · View at Google Scholar · View at Scopus
  19. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, “Robust face recognition via sparse representation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 2, pp. 210–227, 2009. View at Publisher · View at Google Scholar · View at Scopus
  20. Y. Xu, D. Zhang, J. Yang, and J. Y. Yang, “A two-phase test sample sparse representation method for use with face recognition,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 21, no. 9, pp. 1255–1262, 2011. View at Publisher · View at Google Scholar · View at Scopus
  21. Y. Xu, Q. Zhu, Z. Fan, D. Zhang, J. Mi, and Z. Lai, “Using the idea of the sparse representation to perform coarse-to-fine face recognition,” Information Sciences, vol. 238, pp. 138–148, 2013. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  22. S. Liu, Y. Peng, X. Ben, W. Yang, and G. Qiu, “A novel label learning algorithm for face recognition,” Signal Processing, vol. 124, pp. 141–146, 2016. View at Publisher · View at Google Scholar · View at Scopus
  23. I. Naseem, R. Togneri, and M. Bennamoun, “Linear regression for face recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 11, pp. 2106–2112, 2010. View at Publisher · View at Google Scholar · View at Scopus
  24. Z. Zhang, Y. Xu, J. Yang, X. Li, and D. Zhang, “A survey of sparse representation: algorithms and applications,” IEEE Access, vol. 3, pp. 490–530, 2015. View at Publisher · View at Google Scholar
  25. S. Xiang, F. Nie, G. Meng, C. Pan, and C. Zhang, “Discriminative least squares regression for multiclass classification and feature selection,” IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 11, pp. 1738–1754, 2012. View at Publisher · View at Google Scholar · View at Scopus
  26. Q. Li, B. Xie, J. You, W. Bian, and D. Tao, “Correlated logistic model with elastic net regularized for multilabel image classification,” IEEE Transactions on Image Processing, vol. 25, no. 8, pp. 3801–3813, 2016. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  27. C. Gong, D. Tao, W. Liu, L. Liu, and J. Yang, “Label propagation via teaching-to-learn and learning-to-teach,” IEEE Transactions on Neural Networks Learning Systems, vol. 28, no. 6, pp. 1452–1465, 2017. View at Google Scholar
  28. C. Gong, T. Liu, D. Tao, K. Fu, E. Tu, and J. Yang, “Deformed Graph Laplacian for Semisupervised Learning,” IEEE Transactions on Neural Networks and Learning Systems, vol. 26, no. 10, pp. 2261–2274, 2015. View at Publisher · View at Google Scholar · View at Scopus
  29. C. Xu, D. Tao, and C. Xu, “Large-Margin Multi-Label Causal Feature Learning,” in Proceedings of the 29th Conference on Artificial Intelligence (AAAI '15), pp. 1924–1930, 2015.
  30. T. Liu, D. Tao, M. Song, and S. J. Maybank, “Algorithm-dependent generalization bounds for multi-task learning,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 2, article A4, pp. 227–241, 2017. View at Publisher · View at Google Scholar · View at Scopus
  31. C. J. C. Burges, “A tutorial on support vector machines for pattern recognition,” Data Mining and Knowledge Discovery, vol. 2, no. 2, pp. 121–167, 1998. View at Publisher · View at Google Scholar · View at Scopus
  32. A. J. Smola and B. Sch\"olkopf, “A tutorial on support vector regression,” Statistics and Computing, vol. 14, no. 3, pp. 199–222, 2004. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  33. B. Schölkopf, A. Smola, and K.-R. Müller, “Nonlinear component analysis as a kernel eigenvalue problem,” Neural Computation, vol. 10, no. 5, pp. 1299–1319, 1998. View at Publisher · View at Google Scholar
  34. Y. Xu, D. Zhang, F. Song, J.-Y. Yang, Z. Jing, and M. Li, “A method for speeding up feature extraction based on KPCA,” Neurocomputing, vol. 70, no. 4–6, pp. 1056–1061, 2007. View at Publisher · View at Google Scholar · View at Scopus
  35. S. Mika, G. Ratsch, J. Weston, B. Scholkopf, and K.-R. Muller, “Fisher discriminant analysis with kernels,” in Proceedings of the 9th IEEE Signal Processing Society Workshop on Neural Networks for Signal Processing (NNSP '99), pp. 41–48, Madison, Wis, USA, August 1999. View at Publisher · View at Google Scholar · View at Scopus
  36. K. Yu, L. Ji, and X. Zhang, “Kernel nearest-neighbor algorithm,” Neural Processing Letters, vol. 15, no. 2, pp. 147–156, 2002. View at Publisher · View at Google Scholar · View at Scopus
  37. L. Zhang, W.-D. Zhou, P.-C. Chang et al., “Kernel sparse representation-based classifier,” IEEE Transactions on Signal Processing, vol. 60, no. 4, pp. 1684–1695, 2012. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  38. Y. Xu, Z. Fan, and Q. Zhu, “Feature space-based human face image representation and recognition,” Optical Engineering, vol. 51, no. 1, Article ID 017205, 2012. View at Publisher · View at Google Scholar · View at Scopus
  39. K.-R. Müller, S. Mika, G. Rätsch, K. Tsuda, and B. Schölkopf, “An introduction to kernel-based learning algorithms,” IEEE Transactions on Neural Networks and Learning Systems, vol. 12, no. 2, pp. 181–201, 2001. View at Publisher · View at Google Scholar · View at Scopus
  40. M. Kim, “Accelerated max-margin multiple kernel learning,” Applied Intelligence, vol. 38, no. 1, pp. 45–57, 2013. View at Publisher · View at Google Scholar · View at Scopus
  41. C. Xu, T. Liu, D. Tao, and C. Xu, “Local Rademacher complexity for multi-label learning,” IEEE Transactions on Image Processing, vol. 25, no. 3, pp. 1495–1507, 2016. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  42. K. Petersen and M. Pedersen, The Matrix Cookbook, 2006, http://matrixcookbook.com/.
  43. Y. Xu, X. Z. Fang, X. L. Li, J. Yang, J. You, and H. Liu, “Data uncertainty in face recognition,” IEEE Transactions on Cybernetics, 2014. View at Publisher · View at Google Scholar