Table of Contents Author Guidelines Submit a Manuscript
Computational Intelligence and Neuroscience
Volume 2016 (2016), Article ID 8091267, 17 pages
http://dx.doi.org/10.1155/2016/8091267
Research Article

Adaptive Online Sequential ELM for Concept Drift Tackling

Faculty of Computer Science, University of Indonesia, Depok, West Java 16424, Indonesia

Received 29 January 2016; Accepted 17 May 2016

Academic Editor: Stefan Haufe

Copyright © 2016 Arif Budiman et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. J. A. Gama, I. Žliobaitė, A. Bifet, M. Pechenizkiy, and A. Bouchachia, “A survey on concept drift adaptation,” ACM Computing Surveys, vol. 46, no. 4, article 44, pp. 1–37, 2014. View at Publisher · View at Google Scholar · View at Scopus
  2. P. B. Dongre and L. G. Malik, “A review on real time data stream classification and adapting to various concept drift scenarios,” in Proceedings of the 4th IEEE International Advance Computing Conference (IACC '14), pp. 533–537, Gurgaon, India, February 2014. View at Publisher · View at Google Scholar · View at Scopus
  3. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, “Extreme learning machine: theory and applications,” Neurocomputing, vol. 70, no. 1–3, pp. 489–501, 2006. View at Publisher · View at Google Scholar · View at Scopus
  4. G.-B. Huang, H. Zhou, X. Ding, and R. Zhang, “Extreme learning machine for regression and multiclass classification,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 42, no. 2, pp. 513–529, 2012. View at Publisher · View at Google Scholar · View at Scopus
  5. G.-B. Huang, “An insight into extreme learning machines: random neurons, random features and kernels,” Cognitive Computation, vol. 6, no. 3, pp. 376–390, 2014. View at Publisher · View at Google Scholar · View at Scopus
  6. G. Huang, G.-B. Huang, S. Song, and K. You, “Trends in extreme learning machines: a review,” Neural Networks, vol. 61, pp. 32–48, 2015. View at Publisher · View at Google Scholar · View at Scopus
  7. G.-B. Huang, “What are extreme learning machines? filling the gap between Frank Rosenblatt’s dream and John von Neumann’s puzzle,” Cognitive Computation, vol. 7, no. 3, pp. 263–278, 2015. View at Publisher · View at Google Scholar · View at Scopus
  8. N.-Y. Liang, G.-B. Huang, P. Saratchandran, and N. Sundararajan, “A fast and accurate online sequential learning algorithm for feedforward networks,” IEEE Transactions on Neural Networks, vol. 17, no. 6, pp. 1411–1423, 2006. View at Publisher · View at Google Scholar · View at Scopus
  9. Y. Lan, Y. C. Soh, and G.-B. Huang, “A constructive enhancement for Online Sequential Extreme Learning Machine,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN '09), pp. 1708–1713, Atlanta, Ga, USA, June 2009. View at Publisher · View at Google Scholar · View at Scopus
  10. L. I. Kuncheva, “Classifier ensembles for detecting concept change in streaming data: overview and perspectives,” in Proceedings of the 2nd Workshop SUEMA (ECAI '08), pp. 5–10, Patras, Greece, 2008.
  11. T. G. Dietterich, “Ensemble methods in machine learning,” in Proceedings of the 1st International Workshop on Multiple Classifier Systems (MCS '00), pp. 1–15, Springer, 2000. View at Google Scholar
  12. G. Chandrashekar and F. Sahin, “A survey on feature selection methods,” Computers and Electrical Engineering, vol. 40, no. 1, pp. 16–28, 2014. View at Publisher · View at Google Scholar · View at Scopus
  13. I. Žliobaitė, “Learning under concept drift: an overview,” CoRR-Computing Research Repository, 2010. View at Google Scholar
  14. A. Budiman, M. I. Fanany, and C. Basaruddin, “Constructive, robust and adaptive OS-ELM in human action recognition,” in Proceedings of the International Conference on Industrial Automation, Information and Communications Technology (IAICT '14), pp. 39–45, Bali, Indonesia, August 2014. View at Publisher · View at Google Scholar · View at Scopus
  15. S. J. Pan and Q. Yang, “A survey on transfer learning,” IEEE Transactions on Knowledge and Data Engineering, vol. 22, no. 10, pp. 1345–1359, 2010. View at Publisher · View at Google Scholar · View at Scopus
  16. Q. Yang, “Transfer learning beyond text classification,” in Proceedings of the 1st Asian Conference on Machine Learning (ACML '09), Advances in Machine Learning, pp. 10–22, Springer, Berlin, Germany, 2009.
  17. Y. LeCun and C. Cortes, “MNIST handwritten digit database,” 2010, http://yann.lecun.com/exdb/mnist/.
  18. S. Roweis, Data for matlab hackers handwritten digits, http://www.cs.nyu.edu/~roweis/data.html.
  19. W. N. Street and Y. Kim, “A streaming ensemble algorithm (SEA) for large-scale classification,” in Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '01), 2001.
  20. J. Z. Kolter and M. A. Maloof, “Dynamic weighted majority: an ensemble method for drifting concepts,” Journal of Machine Learning Research, vol. 8, pp. 2755–2790, 2007. View at Google Scholar · View at Scopus
  21. J. Gao, W. Fan, J. Han, and P. S. Yu, “A general framework for mining concept-drifting data streams with skewed distributions,” in Proceedings of the 2007 SIAM International Conference on Data Mining (SDM '07), 2007. View at Publisher · View at Google Scholar
  22. L. Kuncheva, “Classifier ensembles for changing environments,” in Multiple Classifier Systems, F. Roli, J. Kittler, and T. Windeatt, Eds., vol. 3077 of Lecture Notes in Computer Science, pp. 1–15, Springer, Berlin, Germany, 2004. View at Publisher · View at Google Scholar
  23. A. van Schaik and J. Tapson, “Online and adaptive pseudoinverse solutions for ELM weights,” Neurocomputing, vol. 149, pp. 233–238, 2015. View at Publisher · View at Google Scholar · View at Scopus
  24. K. Cao, G. Wang, D. Han, J. Ning, and X. Zhang, “Classification of uncertain data streams based on extreme learning machine,” Cognitive Computation, vol. 7, no. 1, pp. 150–160, 2015. View at Publisher · View at Google Scholar · View at Scopus
  25. L. Devroye, L. Györfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition, Springer, New York, NY, USA, 1996. View at Publisher · View at Google Scholar · View at MathSciNet
  26. C. M. Grinstead and J. L. Snell, Introduction to Probability, AMS, 2003, http://www.dartmouth.edu/~chance/teaching_aids/books_articles/probability_book/book.html.
  27. L. C. A. Corsten, “Statistical methods: the geometric approach (David J. Saville and Graham R. Wood),” SIAM Review, vol. 34, no. 3, pp. 506–508, 1992. View at Publisher · View at Google Scholar
  28. R. Strack, Geometric approach to support vector machines learning for large datasets [Ph.D. thesis], Virginia Commonwealth University, Richmond, Va, USA, 2013.
  29. A. Iosifidis, “Extreme learning machine based supervised subspace learning,” Neurocomputing, vol. 167, pp. 158–164, 2015. View at Publisher · View at Google Scholar · View at Scopus
  30. O. Ludwig Junior, D. Delgado, V. Gonçalves, and U. Nunes, “Trainable classifier-fusion schemes: an application to pedestrian detection,” in Proceedings of the 12th International IEEE Conference on Intelligent Transportation Systems (ITSC '09), pp. 1–6, St. Louis, Mo, USA, October 2009. View at Publisher · View at Google Scholar · View at Scopus
  31. M.-T. T. Hoang, H. T. Huynh, N. H. Vo, and Y. Won, “A robust online sequential extreme learning machine,” in Proceedings of the 4th International Symposium on Neural Networks: Advances in Neural Networks, pp. 1077–1086, Springer, Berlin, Germany, 2007.
  32. A. Dries and U. Rückert, “Adaptive concept drift detection,” Statistical Analysis and Data Mining, vol. 2, no. 5-6, pp. 311–327, 2009. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  33. K. Nishida and K. Yamauchi, “Adaptive classifiers-ensemble system for tracking concept drift,” in Proceedings of the 6th International Conference on Machine Learning and Cybernetics (ICMLC '07), pp. 3607–3612, Hong Kong, August 2007. View at Publisher · View at Google Scholar · View at Scopus
  34. C. Alippi, G. Boracchi, and M. Roveri, “Just-in-time classifiers for recurrent concepts,” IEEE Transactions on Neural Networks and Learning Systems, vol. 24, no. 4, pp. 620–634, 2013. View at Publisher · View at Google Scholar · View at Scopus
  35. G. H. Golub and C. F. Van Loan, Matrix Computations, Johns Hopkins University Press, Baltimore, Md, USA, 3rd edition, 1996. View at MathSciNet
  36. S. K. Wagh, V. K. Pachghare, and S. R. Kolhe, “Survey on intrusion detection system using machine learning techniques,” International Journal of Computer Applications, vol. 78, no. 16, pp. 30–37, 2013. View at Publisher · View at Google Scholar
  37. J. Gama, “Knowledge discovery from ubiquitous streams—datasets for concept drift,” http://www.liaad.up.pt/kdus/products/datasets-for-concept-drift.
  38. B. Mirza, Z. Lin, and K.-A. Toh, “Weighted online sequential extreme learning machine for class imbalance learning,” Neural Processing Letters, vol. 38, no. 3, pp. 465–486, 2013. View at Publisher · View at Google Scholar · View at Scopus
  39. N. Zhang, S. Ding, and Z. Shi, “Denoising Laplacian multi-layer extreme learning machine,” Neurocomputing, vol. 171, pp. 1066–1074, 2016. View at Publisher · View at Google Scholar · View at Scopus
  40. H. Zhou, G.-B. Huang, Z. Lin, H. Wang, and Y. C. Soh, “Stacked extreme learning machines,” IEEE Transactions on Cybernetics, vol. 45, no. 9, pp. 2013–2025, 2015. View at Publisher · View at Google Scholar · View at Scopus
  41. N. Barakat and A. P. Bradley, “Rule extraction from support vector machines: a review,” Neurocomputing, vol. 74, no. 1–3, pp. 178–190, 2010. View at Publisher · View at Google Scholar · View at Scopus