Table of Contents Author Guidelines Submit a Manuscript
Mathematical Problems in Engineering
Volume 2015, Article ID 412957, 11 pages
http://dx.doi.org/10.1155/2015/412957
Research Article

One-Class Classification with Extreme Learning Machine

1School of Computer and Control Engineering, University of Chinese Academy of Sciences, Beijing 101408, China
2Key Laboratory of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS, Beijing 100190, China

Received 13 August 2014; Revised 8 November 2014; Accepted 10 November 2014

Academic Editor: Zhan-li Sun

Copyright © 2015 Qian Leng et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. D. M. J. Tax, One-class classification [Ph.D. thesis], Delft University of Technology, 2001.
  2. P. Juszczak, Learning to recognise. A study on one-class classification and active learning [Ph.D. thesis], Delft University of Technology, Delft, Netherlands, 2006.
  3. H. J. Shin, D.-H. Eom, and S.-S. Kim, “One-class support vector machines—an application in machine fault detection and classification,” Computers & Industrial Engineering, vol. 48, no. 2, pp. 395–408, 2005. View at Publisher · View at Google Scholar · View at Scopus
  4. G. Cohen, M. Hilario, H. Sax, S. Hugonnet, C. Pellegrini, and A. Geissbuhler, “An application of one-class support vector machines to nosocomial infection detection,” in Proceedings of Medical Informatics, 2004.
  5. K. Kennedy, B. Mac Namee, and S. J. Delany, “Credit scoring: solving the low default portfolio problem using one-class classification,” in Proceedings of the 20th Irish Conference on Artificial Intelligence and Cognitive Science, pp. 168–177, 2009.
  6. S. S. Khan and M. G. Madden, “One-class classification: taxonomy of study and review of techniques,” Knowledge Engineering Review, vol. 29, no. 3, pp. 345–374, 2014. View at Publisher · View at Google Scholar · View at Scopus
  7. E. Parzen, “On estimation of a probability density function and mode,” The Annals of Mathematical Statistics, vol. 33, no. 3, pp. 1065–1076, 1962. View at Publisher · View at Google Scholar · View at MathSciNet
  8. R. P. W. Duin, “On the choice of smoothing parameters for Parzen estimators of probability density functions,” IEEE Transactions on Computers, vol. 25, no. 11, pp. 1175–1179, 1976. View at Publisher · View at Google Scholar · View at Scopus
  9. B. Schölkopf, J. C. Platt, J. Shawe-Taylor, A. J. Smola, and R. C. Williamson, “Estimating the support of a high-dimensional distribution,” Neural Computation, vol. 13, no. 7, pp. 1443–1471, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  10. D. M. J. Tax and R. P. W. Duin, “Support vector data description,” Machine Learning, vol. 54, no. 1, pp. 45–66, 2004. View at Publisher · View at Google Scholar · View at Scopus
  11. E. Pekalska, D. M. J. Tax, and R. P. W. Duin, “One-class LP classifier for dissimilarity representations,” in Neural Information Processing Systems, pp. 761–768, MIT Press, Cambridge, Mass, USA, 2003. View at Google Scholar
  12. C. Campbell and K. P. Bennett, “A linear programming approach to novelty detection,” in Neural Information Processing Systems, pp. 395–401, 2000. View at Google Scholar
  13. G. R. G. Lanckriet, L. El Ghaoui, and M. I. Jordan, “Robust novelty detection with single-class MPM,” in Advances in Neural Information Processing Systems, S. Becker, S. Thrun, and T. Obermayer, Eds., vol. 15, pp. 905–912, MIT Press, Cambridge, Mass, USA, 2003. View at Google Scholar
  14. P. Juszczak, D. M. J. Tax, E. Pękalska, and R. P. W. Duin, “Minimum spanning tree based one-class classifier,” Neurocomputing, vol. 72, no. 7–9, pp. 1859–1869, 2009. View at Publisher · View at Google Scholar · View at Scopus
  15. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, “Extreme learning machine: a new learning scheme of feedforward neural networks,” in Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN '04), pp. 985–990, Budapest, Hungary, July 2004. View at Publisher · View at Google Scholar · View at Scopus
  16. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, “Extreme learning machine: theory and applications,” Neurocomputing, vol. 70, no. 1–3, pp. 489–501, 2006. View at Publisher · View at Google Scholar · View at Scopus
  17. G.-B. Huang, H. Zhou, X. Ding, and R. Zhang, “Extreme learning machine for regression and multiclass classification,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 42, no. 2, pp. 513–529, 2012. View at Publisher · View at Google Scholar · View at Scopus
  18. W. Zhu, J. Miao, and L. Qing, “Constrained extreme learning machine: a novel highly discriminative random feedforward neural network,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN '14), Beijing, China, June 2014.
  19. P. L. Bartlett, “The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network,” IEEE Transactions on Information Theory, vol. 44, no. 2, pp. 525–536, 1998. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  20. G.-B. Huang, L. Chen, and C.-K. Siew, “Universal approximation using incremental constructive feedforward networks with random hidden nodes,” IEEE Transactions on Neural Networks, vol. 17, no. 4, pp. 879–892, 2006. View at Publisher · View at Google Scholar · View at Scopus
  21. G.-B. Huang and L. Chen, “Convex incremental extreme learning machine,” Neurocomputing, vol. 70, no. 16-18, pp. 3056–3062, 2007. View at Publisher · View at Google Scholar · View at Scopus
  22. R. Fletcher, Practical Methods of Optimization: Volume 2 Constrained Optimization, Wiley, New York, NY, USA, 1981. View at MathSciNet
  23. N. Y. Liang, G. B. Huang, P. Saratchandran, and N. Sundararajan, “A fast and accurate online sequential learning algorithm for feedforward networks,” IEEE Transactions on Neural Networks, vol. 17, no. 6, pp. 1411–1423, 2006. View at Publisher · View at Google Scholar · View at Scopus
  24. G.-B. Huang, P. Saratchandran, and N. Sundararajan, “An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks,” IEEE Transactions on Systems, Man, and Cybernetics. Part B: Cybernetics, vol. 34, no. 6, pp. 2284–2292, 2004. View at Publisher · View at Google Scholar · View at Scopus
  25. M.-B. Li, G.-B. Huang, P. Saratchandran, and N. Sundararajan, “Fully complex extreme learning machine,” Neurocomputing, vol. 68, no. 1-4, pp. 306–314, 2005. View at Publisher · View at Google Scholar · View at Scopus
  26. G.-B. Huang, M.-B. Li, L. Chen, and C.-K. Siew, “Incremental extreme learning machine with fully complex hidden nodes,” Neurocomputing, vol. 71, no. 4–6, pp. 576–583, 2008. View at Publisher · View at Google Scholar · View at Scopus
  27. G.-B. Huang, X. Ding, and H. Zhou, “Optimization method based extreme learning machine for classification,” Neurocomputing, vol. 74, no. 1–3, pp. 155–163, 2010. View at Publisher · View at Google Scholar · View at Scopus
  28. G. Yin, Y.-T. Zhang, Z.-N. Li, G.-Q. Ren, and H.-B. Fan, “Online fault diagnosis method based on incremental support vector data description and extreme learning machine with incremental output structure,” Neurocomputing, vol. 128, pp. 224–231, 2014. View at Publisher · View at Google Scholar · View at Scopus
  29. T. Wang, S. Wang, and H. Zhang, “Dynamic extreme learning machine: a learning algorithm for neural network with elastic output structure,” in Proceedings of the International Symposium on Intelligent Information Systems and Applications, pp. 271–275, 2009.
  30. M. van Heeswijk, Y. Miche, E. Oja, and A. Lendasse, “GPU-accelerated and parallelized ELM ensembles for large-scale regression,” Neurocomputing, vol. 74, no. 16, pp. 2430–2437, 2011. View at Publisher · View at Google Scholar · View at Scopus
  31. Y. Sun, Y. Yuan, and G. Wang, “An OS-ELM based distributed ensemble classification framework in P2P networks,” Neurocomputing, vol. 74, no. 16, pp. 2438–2443, 2011. View at Publisher · View at Google Scholar · View at Scopus
  32. Y. Lan, Y. C. Soh, and G.-B. Huang, “Ensemble of online sequential extreme learning machine,” Neurocomputing, vol. 72, no. 13–15, pp. 3391–3395, 2009. View at Publisher · View at Google Scholar · View at Scopus
  33. G.-B. Huang, D. H. Wang, and Y. Lan, “Extreme learning machines: a survey,” International Journal of Machine Learning and Cybernetics, vol. 2, no. 2, pp. 107–122, 2011. View at Publisher · View at Google Scholar · View at Scopus
  34. Z.-L. Sun, K.-F. Au, and T.-M. Choi, “A neuro-fuzzy inference system through integration of fuzzy logic and extreme learning machines,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 37, no. 5, pp. 1321–1331, 2007. View at Publisher · View at Google Scholar · View at Scopus
  35. H. J. Rong, G. B. Huang, N. Sundararajan, and P. Saratchandran, “Online sequential fuzzy extreme learning machine for function approximation and classification problems,” IEEE Transactions on Systems, Man, and Cybernetics. Part B: Cybernetics, vol. 39, no. 4, pp. 1067–1072, 2009. View at Publisher · View at Google Scholar · View at Scopus
  36. Z. Deng, K.-S. Choi, L. Cao, and S. Wang, “T2fela: type-2 fuzzy extreme learning algorithm for fast training of interval type-2 TSK fuzzy logic system,” IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 4, pp. 664–676, 2014. View at Publisher · View at Google Scholar · View at Scopus
  37. J. M. Mendel, Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions, Prentice-Hall, 2001.
  38. S. O. Olatunji, A. Selamat, and A. Abdulraheem, “A hybrid model through the fusion of type-2 fuzzy logic systems and extreme learning machines for modelling permeability prediction,” Information Fusion, vol. 16, no. 1, pp. 29–45, 2014. View at Publisher · View at Google Scholar · View at Scopus
  39. J. Platt, “Sequential minimal optimization: a fast algorithm for training support vector machines,” Microsoft Research Technical Report MSR-TR-98-14, 1998. View at Google Scholar
  40. P. Laskov, C. Gehl, S. Krüger, and K.-R. Müller, “Incremental support vector learning: analysis, implementation and applications,” Journal of Machine Learning Research, vol. 7, pp. 1909–1936, 2006. View at Google Scholar · View at MathSciNet · View at Scopus
  41. D. M. J. Tax and K.-R. Müller, “A consistency-based model selection for one-class classification,” in Proceedings of the 17th International Conference on Pattern Recognition (ICPR '04), pp. 363–366, IEEE Computer Society, Los Alamitos, Calif, USA, August 2004. View at Scopus
  42. A. G. Arkedev and E. M. Braverman, Computers and Pattern Recognition, Thompson, Washington, DC, USA, 1966.
  43. L. Manevitz and M. Yousef, “One-class document classification via Neural Networks,” Neurocomputing, vol. 70, no. 7–9, pp. 1466–1481, 2007. View at Publisher · View at Google Scholar · View at Scopus
  44. M. F. Jiang, S. S. Tseng, and C. M. Su, “Two-phasee clustering process for outliers detection,” Pattern Recognition Letters, vol. 22, no. 6-7, pp. 691–700, 2001. View at Publisher · View at Google Scholar · View at Scopus
  45. D. S. Hochbaum and D. B. Shmoys, “A best possible heuristic for the k-center problem,” Mathematics of Operations Research, vol. 10, no. 2, pp. 180–184, 1985. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  46. D. M. J. Tax and R. P. W. Duin, “Data descriptions in subspaces,” in Proceedings of the International Conference on Pattern Recognition, vol. 2, pp. 672–675, 2000.
  47. E. M. Knorr, R. T. Ng, and V. Tucakov, “Distance-based outliers: algorithms and applications,” The VLDB Journal, vol. 8, no. 3-4, pp. 237–253, 2000. View at Publisher · View at Google Scholar · View at Scopus
  48. C. M. Bishop, Neural Networks for Pattern Recognition, Oxford University Press, Walton Street, Oxford, UK, 1995. View at MathSciNet
  49. C.-C. Chang and C.-J. Lin, “LIBSVM: a Library for support vector machines,” ACM Transactions on Intelligent Systems and Technology, vol. 2, no. 3, article 27, 2011. View at Publisher · View at Google Scholar · View at Scopus
  50. D. M. J. Tax, DDtools, the Data Description Toolbox for Matlab, 2014, http://prlab.tudelft.nl/david-tax/dd_tools.html.
  51. K. Bache and M. Lichman, UCI Machine Learning Repository, School of Information and Computer Sciences, University of California, Irvine, Calif, USA, 2013, http://archive.ics.uci.edu/ml.html.
  52. C. J. van Rijsbergen, Information Retrieval, Butterworths, London, UK, 1979.