Table of Contents Author Guidelines Submit a Manuscript
Mathematical Problems in Engineering
Volume 2015 (2015), Article ID 874032, 10 pages
http://dx.doi.org/10.1155/2015/874032
Research Article

Adaptive Ensemble with Human Memorizing Characteristics for Data Stream Mining

1State Key Laboratory of High Performance Computing, National University of Defense Technology, Changsha 410073, China
2School of Computer Science, National University of Defense Technology, Changsha 410073, China
3School of Computer and Information Engineering, Hunan University of Commerce, Changsha 410205, China

Received 9 January 2015; Accepted 18 May 2015

Academic Editor: Haibo He

Copyright © 2015 Yanhuang Jiang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. J. Gama, Knowledge Discovery from Data Streams, Chapman & Hall, London, UK, 1st edition, 2010.
  2. W. N. Street and Y. Kim, “A streaming ensemble algorithm (SEA) for large-scale classification,” in Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '01), pp. 377–382, August 2001. View at Scopus
  3. A. Bifet, G. Holmes, R. Kirkby, and B. Pfahringer, “MOA: massive online analysis,” Journal of Machine Learning Research, vol. 11, pp. 1601–1604, 2010. View at Google Scholar · View at Scopus
  4. E. Cohen and M. J. Strauss, “Maintaining time-decaying stream aggregates,” Journal of Algorithms, vol. 59, no. 1, pp. 19–36, 2006. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  5. A. Bifet and R. Gavaldà, “Learning from time-changing data with adaptive windowing,” in Proceedings of the 7th SIAM International Conference on Data Mining, pp. 443–448, April 2007. View at Scopus
  6. E. S. Page, “Continuous inspection schemes,” Biometrika, vol. 41, no. 1-2, pp. 100–115, 1954. View at Publisher · View at Google Scholar · View at MathSciNet
  7. J. Gama, P. Medas, G. Castillo, and P. Rodrigues, “Learning with drift detection,” in Advances in Artificial Intelligence—SBIA 2004: Proceedings of the 17th Brazilian Symposium on Artificial Intelligence, Sao Luis, Maranhao, Brazil, September 29–Ocotber 1, 2004, vol. 3171 of Lecture Notes in Computer Science, pp. 286–295, Springer, Berlin, Germany, 2004. View at Publisher · View at Google Scholar
  8. M. Baena-García, J. D. Campo-Ávila, R. Fidalgo, A. Bifet, R. Gavaldà, and R. Morales-Bueno, “Early drift detection method,” in Proceedings of the 4th International Workshop on Knowledge Discovery from Data Streams, pp. 1–10, 2006.
  9. H. Wang, W. Fan, P. S. Yu, and J. Han, “Mining concept-drifting data streams using ensemble classifiers,” in Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '03), pp. 226–235, August 2003. View at Publisher · View at Google Scholar · View at Scopus
  10. K. Nishida, K. Yamauchi, and T. Omori, “ACE: adaptive classifiers-ensemble system for concept-drifting environments,” in Proceedings of the 6th International Workshop on Multiple Classifier Systems, pp. 176–185, June 2005.
  11. R. Elwell and R. Polikar, “Incremental learning of concept drift in nonstationary environments,” IEEE Transactions on Neural Networks, vol. 22, no. 10, pp. 1517–1531, 2011. View at Publisher · View at Google Scholar · View at Scopus
  12. Q. Zhao, Y. Jiang, and M. Xu, “Incremental learning by heterogeneous bagging ensemble,” in Advanced Data Mining and Applications: Proceedings of the 6th International Conference, ADMA 2010, Chongqing, China, November 19–21, 2010, Part II, vol. 6441 of Lecture Notes in Computer Science, pp. 1–12, Springer, Berlin, Germany, 2010. View at Publisher · View at Google Scholar
  13. D. Brzezinski and J. Stefanowski, “Accuracy updated ensemble for data streams with concept drift,” in Proceedings of the 6th International Conference on Hybrid Artificial Intelligent Systems (HAIS '11), II, pp. 155–163, May 2011.
  14. D. Brzezinski and J. Stefanowski, “Reacting to different types of concept drift: the accuracy updated ensemble algorithm,” IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 1, pp. 81–94, 2014. View at Publisher · View at Google Scholar · View at Scopus
  15. H. Ebbinghaus, Memory: A Contribution to Experimental Psychology, translated by: H. A. Ruger, C. E. Bussenius, 1885, http://nwkpsych.rutgers.edu/~jose/courses/578_mem_learn/2012/readings/Ebbinghaus_1885.pdf.
  16. A. Lazarevic and Z. Obradovic, “Effective pruning of neural network classifier ensembles,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN' 01), pp. 796–801, July 2001. View at Scopus
  17. Q.-L. Zhao, Y.-H. Jiang, and M. Xu, “A fast ensemble pruning algorithm based on pattern mining process,” Data Mining and Knowledge Discovery, vol. 19, no. 2, pp. 277–292, 2009. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  18. G. Martinez-Muñoz, D. Hernández-Lobato, and A. Suarez, “An analysis of ensemble pruning techniques based on ordered aggregation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 2, pp. 245–259, 2009. View at Publisher · View at Google Scholar · View at Scopus
  19. http://moa.cms.waikato.ac.nz/.
  20. M. Harries, “SPLICE-2 comparative evaluation: electricity pricing,” Tech. Rep. 9905, School of Computer Science and Engineering, University of New South Wales, New South Wales, Australia, 1999. View at Google Scholar
  21. UCI Machine Learning Repository, http://archive.ics.uci.edu/ml/.
  22. J. R. Quinlan, C4.5: Programs for Machine Learning, Morgan Kaufmann Publishers, 1993.
  23. G. Martinez-Munoz and A. Suarez, “Aggregation ordering in bagging,” in Proceedings of the IASTED International Conference on Artificial Intelligence and Applications, pp. 258–263, 2004.
  24. Q. Zhao and Y. Jiang, “LibEDM: a platform for ensemble based data mining,” in Proceedings of the IEEE International Conference on Data Mining Workshop (ICDMW '14), pp. 1250–1253, IEEE, Shenzhen, China, December 2014. View at Publisher · View at Google Scholar
  25. https://github.com/Qiangli-Zhao/LibEDM.
  26. http://www.cs.waikato.ac.nz/ml/weka.
  27. J. Demsar, “Statistical comparisons of classifiers over multiple data sets,” Journal of Machine Learning Research, vol. 7, pp. 1–30, 2006. View at Google Scholar · View at MathSciNet
  28. S. García and F. Herrera, “An extension on ‘statistical comparisons of classifiers over multiple data sets’ for all pairwise comparisons,” Journal of Machine Learning Research, vol. 9, pp. 2677–2694, 2008. View at Google Scholar · View at Scopus
  29. P. Zhang, X. Zhu, and L. Guo, “Mining data streams with labeled and unlabeled training examples,” in Proceedings of the 9th IEEE International Conference on Data Mining (ICDM '09), pp. 627–636, December 2009. View at Publisher · View at Google Scholar · View at Scopus
  30. J. Xu, H. He, and H. Man, “DCPE co-training: co-training based on diversity of class probability estimation,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN '10), pp. 1–7, 2010.
  31. Z. Ahmadi and H. Beigy, “Semi-supervised ensemble learning of data streams in the presence of concept drift,” in Hybrid Artificial Intelligent Systems: 7th International Conference, HAIS 2012, Salamanca, Spain, March 28–30th, 2012. Proceedings, Part II, vol. 7209 of Lecture Notes in Computer Science, pp. 526–537, Springer, Berlin, Germany, 2012. View at Publisher · View at Google Scholar