Table of Contents Author Guidelines Submit a Manuscript
The Scientific World Journal
Volume 2015 (2015), Article ID 235810, 14 pages
http://dx.doi.org/10.1155/2015/235810
Research Article

Fast Adapting Ensemble: A New Algorithm for Mining Data Streams with Concept Drift

1Department of Computer Science, University of Granma, 85100 Granma, Cuba
2Department of Language and Computer Science, University of Málaga, Complejo Tecnológico, 29071 Málaga, Spain
3Department of Computer Science, University of Camagüey, 70100 Camagüey, Cuba

Received 26 June 2014; Accepted 15 September 2014

Academic Editor: Shifei Ding

Copyright © 2015 Agustín Ortíz Díaz et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. J. Gama, I. Zliobaite, A. Bifet, M. Pechenizkiy, and A. Bouchachia, “A survey on concept drift adaptation,” ACM Computing Surveys, vol. 46, no. 4, article 44, 2014. View at Publisher · View at Google Scholar · View at Scopus
  2. G. Widmer and M. Kubat, “Learning in the presence of concept drift and hidden contexts,” Machine Learning, vol. 23, no. 1, pp. 69–101, 1996. View at Google Scholar · View at Scopus
  3. F. J. Ferrer-Troyano, J. S. Aguilar-Ruiz, and J. C. Riquelme, “Incremental rule learning and border examples selection from numerical data streams,” Journal of Universal Computer Science, vol. 11, no. 8, pp. 1426–1439, 2005. View at Publisher · View at Google Scholar · View at Scopus
  4. L. L. Minku, A. P. White, and X. Yao, “The impact of diversity on online ensemble learning in the presence of concept drift,” IEEE Transactions on Knowledge and Data Engineering, vol. 22, no. 5, pp. 730–742, 2010. View at Publisher · View at Google Scholar · View at Scopus
  5. A. Tsymbal, “The problem of concept drift: definitions and related work,” Tech. Rep. TCD-CS-2004-15, Department of Computer Science, Trinity College, Dublin, Ireland, 2004. View at Google Scholar
  6. J. del Campo-Ávila, Nuevos Enfoques en Aprendizaje Incremental [Ph.D. thesis], Departamento de Lenguajes y Ciencias de la Computación, Universidad de Málaga, 2007.
  7. J. Gama, P. Medas, G. Castillo, and P. Rodríguez, “Learning with drift detection,” in Proceedings of the 17th SBIA Brazilian Symposium on Artificial Intelligence, pp. 286–295, Sao Luis, Brazil, September-October, 2004.
  8. W. Nick Street and Y. Kim, “A streaming ensemble algorithm (SEA) for large-scale classification,” in Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '01), pp. 377–382, New York, NY, USA, August 2001. View at Publisher · View at Google Scholar · View at Scopus
  9. J. Kolter and M. Maloof, “Dynamic weighted majority: a new ensemble method for tracking concept drift,” in Proceedings of the 3rd IEEE International Conference on Data Mining (ICDM '03), pp. 123–130, Melbourne, Australia, November 2003. View at Scopus
  10. H. Wang, W. Fan, P. S. Yu, and J. Han, “Mining concept-drifting data streams using ensemble classifiers,” in Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '03), pp. 226–235, Washington, DC, USA, August 2003. View at Publisher · View at Google Scholar · View at Scopus
  11. M. Deckert, Batch Weighted Ensemble for Mining Data Streams with Concept Drift, Springer, Berlin, Germany, 2011.
  12. P. Gonçalves and R. Barros, RCD: A Recurring Concept Drift Framework, Centro de Informática, Universidad Federal de Pernambuco, Ciudad Universitaria, Recife, Brasil, 2013.
  13. D. Brzezinski and J. Stefanowski, “Accuracy updated ensemble for data streams with concept drift,” in Hybrid Artificial Intelligent Systems, E. Corchado, M. Kurzynski, and M. Wozniak, Eds., vol. 6679 of Lecture Notes in Computer Science, pp. 155–163, Springer, Berlin, Germany, 2011. View at Google Scholar
  14. N. Littlestone and M. K. Warmuth, “The weighted majority algorithm,” Information and Computation, vol. 108, no. 2, pp. 212–261, 1994. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  15. J. Z. Kolter and M. A. Maloof, “Using additive expert ensembles to cope with concept drift,” in Proceedings of the 22nd International Conference on Machine Learning (ICML '05), pp. 449–456, August 2005. View at Publisher · View at Google Scholar · View at Scopus
  16. S. Yue, M. Guojun, L. Xu, and L. Chunnian, “Mining concept drifts from data streams based on multiclassifiers,” in Proceedings of the 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW '07), Beijing Municipal Key Laboratory of Multimedia and Intelligent Software Technology, Beijing, China, 2007.
  17. D. Mejri, R. Khanchel, and M. Limam, “An ensemble method for concept drift in nonstationary environment,” Journal of Statistical Computation and Simulation, vol. 83, no. 6, pp. 1115–1128, 2013. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  18. A. Blum, “Empirical support for winnow and weighted-majority algorithms: results on a calendar scheduling domain,” Machine Learning, vol. 26, no. 1, pp. 5–23, 1997. View at Publisher · View at Google Scholar · View at Scopus
  19. L. L. Minku and X. Yao, “DDD: a new ensemble approach for dealing with concept drift,” IEEE Transactions on Knowledge and Data Engineering, vol. 24, no. 4, pp. 619–633, 2012. View at Publisher · View at Google Scholar · View at Scopus
  20. L. Breiman, “Bagging predictors,” Machine Learning, vol. 24, no. 2, pp. 123–140, 1996. View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  21. Y. Freund, “Boosting a weak learning algorithm by majority,” in Proceedings of the 3rd Annual Workshop on Computational Learning Theory, 1990.
  22. N. Oza and S. Russell, “Online bagging and boosting,” in Artificial Intelligence and Statistics 2001, pp. 105–112, Morgan Kaufmann, 2001. View at Google Scholar
  23. A. Bifet, G. Holmes, B. Pfahringer, R. Kirkby, and R. Gavaldà, “New ensemble methods for evolving data streams,” in Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '09), pp. 139–147, Paris, France, July 2009. View at Publisher · View at Google Scholar · View at Scopus
  24. A. Bifet and R. Gavaldà, “Learning from time-changing data with adaptive windowing,” in Proceedings of the 7th SIAM International Conference on Data Mining, pp. 443–448, April 2007. View at Scopus
  25. K. K. Wankhade and S. S. Dongre, “A new adaptive ensemble boosting classifier for concept drifting stream data,” International Journal of Modeling and Optimization, vol. 2, no. 4, pp. 493–497, 2012. View at Google Scholar
  26. S. Dongre and L. Malik, “Algorithm to handle concept drifting in data stream mining,” IJCSN International Journal of Computer Science and Network, vol. 2, no. 1, 2013. View at Google Scholar
  27. K. Nishida, K. Yamauchi, and T. Omori, “ACE: adaptive classifiers-ensemble system for concept-drifting environments,” in Multiple Classifier Systems, vol. 3541 of Lecture Notes in Computer Science, pp. 176–185, Springer, Heidelberg, Germany, 2005. View at Publisher · View at Google Scholar
  28. S. Ramamurthy and R. Bhatnagar, “Tracking recurrent concept drift in streaming data using ensemble classifiers,” in Proceedings of the 6th International Conference on Machine Learning and Applications (ICMLA '07), pp. 404–409, December 2007. View at Publisher · View at Google Scholar · View at Scopus
  29. P. Li, X. Wu, and X. Hu, “Mining recurring concept drifts with limited labeled streaming data,” Journal of Machine Learning Research—Proceedings Track, pp. 241–252, 2010. View at Google Scholar
  30. J. Gama and P. Kosina, Tracking Recurring Concepts with Meta-Learners, Springer, Berlin, Germany, 2009.
  31. A. Tanenbaum, Computer Networks, Prentice-Hall, 2nd edition, 1988.
  32. J. Gama, P. Medas, G. Castillo, and P. Rodrigues, “Learning with drift detection,” in Proceedings of the SBIA Brazilian Symposium on Artificial Intelligence, pp. 286–295, 2004.
  33. M. Baena, J. del Campo, R. Fidalgo, A. Bifet, R. Gavaldá, and R. M. Bueno, “Early drift detection method,” in Proceedings of the 4th International Workshop on Knowledge Discovery from Data Streams, 2006.
  34. P. Domingos and G. Hulten, “Mining high-speed data streams,” in Proceedings of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '00), pp. 71–80, August 2000. View at Scopus
  35. L. l. Mora, I. Fortes, R. Morales-Bueno, and F. Triguero, “Dynamic discretization of continuous values from time series,” in Book “ECML'00”, pp. 280–291, 2000. View at Google Scholar
  36. A. Bifet, G. Holmes, R. Kirkby, and B. Pfahringer, “MOA: massive online analysis,” Journal of Machine Learning Research, vol. 11, pp. 1601–1604, 2010. View at Google Scholar · View at Scopus
  37. J. Bártolo, Learning recurring concepts from data stream in ubiquitous environments [Ph.D. thesis], Universidad Politécnica de Madrid, 2011.