Table of Contents Author Guidelines Submit a Manuscript
Journal of Electrical and Computer Engineering
Volume 2016, Article ID 3919472, 10 pages
http://dx.doi.org/10.1155/2016/3919472
Research Article

A Complete Subspace Analysis of Linear Discriminant Analysis and Its Robust Implementation

School of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, China

Received 21 September 2016; Revised 27 October 2016; Accepted 7 November 2016

Academic Editor: Ping Feng Pai

Copyright © 2016 Zhicheng Lu and Zhizheng Liang. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, “Eigenfaces vs. fisherfaces: recognition using class specific linear projection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711–720, 1997. View at Publisher · View at Google Scholar · View at Scopus
  2. X. Jin, M. Zhao, T. W. S. Chow, and M. Pecht, “Motor bearing fault diagnosis using trace ratio linear discriminant analysis,” IEEE Transactions on Industrial Electronics, vol. 61, no. 5, pp. 2441–2451, 2014. View at Publisher · View at Google Scholar · View at Scopus
  3. M. Kolar and H. Liu, “Optimal feature selection in high-dimensional discriminant analysis,” IEEE Transactions on Information Theory, vol. 61, no. 2, pp. 1063–1083, 2015. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  4. J.-H. Xue and P. Hall, “Why does rebalancing class-unbalanced data improve AUC for linear discriminant analysis?” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, no. 5, pp. 1109–1112, 2015. View at Publisher · View at Google Scholar · View at Scopus
  5. C. Hou, C. Zhang, Y. Wu, and Y. Jiao, “Stable local dimensionality reduction approaches,” Pattern Recognition, vol. 42, no. 9, pp. 2054–2066, 2009. View at Publisher · View at Google Scholar · View at Scopus
  6. Y. Zhang and D.-Y. Yeung, “Semisupervised generalized discriminant analysis,” IEEE Transactions on Neural Networks, vol. 22, no. 8, pp. 1207–1217, 2011. View at Publisher · View at Google Scholar · View at Scopus
  7. P. Howland and H. Park, “Generalizing discriminant analysis using the generalized singular value decomposition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 8, pp. 995–1006, 2004. View at Publisher · View at Google Scholar · View at Scopus
  8. W. Bian and D. Tao, “Asymptotic generalization bound of fisher's linear discriminant analysis,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 36, no. 12, pp. 2325–2337, 2014. View at Publisher · View at Google Scholar · View at Scopus
  9. D. Chu, L.-Z. Liao, M. K. Ng, and X. Wang, “Incremental linear discriminant analysis: a fast algorithm and comparisons,” IEEE Transactions on Neural Networks and Learning Systems, vol. 26, no. 11, pp. 2716–2735, 2015. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  10. J. Zhao, L. Shi, and J. Zhu, “Two-stage regularized linear discriminant analysis for 2-D data,” IEEE Transactions on Neural Networks and Learning Systems, vol. 26, no. 8, pp. 1669–1681, 2015. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  11. A. Sharma and K. K. Paliwal, “Linear discriminant analysis for the small sample size problem: an overview,” International Journal of Machine Learning and Cybernetics, vol. 6, no. 3, pp. 443–454, 2015. View at Publisher · View at Google Scholar · View at Scopus
  12. H. Yu and J. Yang, “A direct LDA algorithm for high-dimensional data—with application to face recognition,” Pattern Recognition, vol. 34, no. 10, pp. 2067–2070, 2001. View at Publisher · View at Google Scholar
  13. H. Li, T. Jiang, and K. Zhang, “Efficient and robust feature extraction by maximum margin criterion,” IEEE Transactions on Neural Networks, vol. 17, no. 1, pp. 157–165, 2006. View at Publisher · View at Google Scholar · View at Scopus
  14. L.-F. Chen, H.-Y. M. Liao, M.-T. Ko, J.-C. Lin, and G.-J. Yu, “New LDA-based face recognition system which can solve the small sample size problem,” Pattern Recognition, vol. 33, no. 10, pp. 1713–1726, 2000. View at Publisher · View at Google Scholar · View at Scopus
  15. H. Çevikalp, M. Neamtu, M. Wilkes, and A. Barkana, “Discriminative common vectors for face recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 1, pp. 4–13, 2005. View at Publisher · View at Google Scholar · View at Scopus
  16. D. Chu and G. S. Thye, “A new and fast implementation for null space based linear discriminant analysis,” Pattern Recognition, vol. 43, no. 4, pp. 1373–1379, 2010. View at Publisher · View at Google Scholar · View at Scopus
  17. A. Sharma and K. K. Paliwal, “A new perspective to null linear discriminant analysis method and its fast implementation using random matrix multiplication with scatter matrices,” Pattern Recognition, vol. 45, no. 6, pp. 2205–2213, 2012. View at Publisher · View at Google Scholar · View at Scopus
  18. K. K. Paliwal and A. Sharma, “Improved pseudoinverse linear discriminant analysis method for dimensionality reduction,” International Journal of Pattern Recognition and Artificial Intelligence, vol. 26, no. 1, Article ID 1250002, 9 pages, 2012. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  19. A. Sharma, K. K. Paliwal, S. Imoto, and S. Miyano, “A feature selection method using improved regularized linear discriminant analysis,” Machine Vision and Applications, vol. 25, no. 3, pp. 775–786, 2014. View at Publisher · View at Google Scholar · View at Scopus
  20. A. Sharma and K. K. Paliwal, “A deterministic approach to regularized linear discriminant analysis,” Neurocomputing, vol. 151, no. 1, pp. 207–214, 2015. View at Publisher · View at Google Scholar · View at Scopus
  21. H. Huang, J. Liu, H. Feng, and T. He, “Ear recognition based on uncorrelated local Fisher discriminant analysis,” Neurocomputing, vol. 74, no. 17, pp. 3103–3113, 2011. View at Publisher · View at Google Scholar · View at Scopus
  22. T. Zhou and D. Tao, “Double shrinking sparse dimension reduction,” IEEE Transactions on Image Processing, vol. 22, no. 1, pp. 244–257, 2013. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  23. H. Li, C. Shen, A. van den Hengel, and Q. Shi, “Worst case linear discriminant analysis as scalable semidefinite feasibility problems,” IEEE Transactions on Image Processing, vol. 24, no. 8, pp. 2382–2392, 2015. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  24. A. Zollanvari and E. R. Dougherty, “Generalized consistent error estimator of linear discriminant analysis,” IEEE Transactions on Signal Processing, vol. 63, no. 11, pp. 2804–2814, 2015. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  25. L. Lu and S. Renals, “Probabilistic linear discriminant analysis for acoustic modeling,” IEEE Signal Processing Letters, vol. 21, no. 6, pp. 702–706, 2014. View at Publisher · View at Google Scholar · View at Scopus
  26. J. Ye and Q. Li, “A two-stage linear discriminant analysis via QR-decomposition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 6, pp. 929–941, 2005. View at Publisher · View at Google Scholar · View at Scopus
  27. K. Fukunaga, Introduction to Statistical Pattern Recognition, Academic Press, New York, NY, USA, 2nd edition, 1990.
  28. G. H. Folub and C. F. Van Loan, Matrix Computation, The Johns Hopkins University Press, Baltimore, Md, USA, 1996.
  29. R. Huang, Q. Liu, H. Lu et al., “Solving the small sample size problem of LDA,” in Proceedings of the 16th International Conference on Pattern Recognition (ICPR '02), IEEE Computer Society, August 2002.
  30. S. A. Armstorng, J. E. Staunton, L. B. Silverman et al., “MLL translocation specify a district gene expression profile at distinguishes a unique leukemia,” Nature Genetics, vol. 30, no. 1, pp. 41–47, 2002. View at Publisher · View at Google Scholar
  31. M. West, C. Blanchette, H. Dressman et al., “Predicting the clinical status of human breast cancer by using gene expression profiles,” Proceedings of the National Academy of Sciences of the United States of America, vol. 98, no. 20, pp. 13462–11467, 2011. View at Google Scholar
  32. C. Blake, E. Keogh, and C. J. Merz, “UCI Repository of machine learning databases,” University of California, Irvine, Calif, USA, 2014, http://www.ics.uci.edu/~mlearn/MLRepository.html.