Table of Contents Author Guidelines Submit a Manuscript
Computational Intelligence and Neuroscience
Volume 2016, Article ID 2842780, 11 pages
http://dx.doi.org/10.1155/2016/2842780
Research Article

Parallelizing Backpropagation Neural Network Using MapReduce and Cascading Model

School of Electrical Engineering and Information, Sichuan University, Chengdu 610065, China

Received 22 November 2015; Revised 16 January 2016; Accepted 19 January 2016

Academic Editor: Jose de Jesus Rubio

Copyright © 2016 Yang Liu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. “Big Data, A New World of Opportunities,” Networked European Software and Services Initiative (NESSI) White Paper, 2012, http://www.nessi-europe.com/Files/Private/NESSI_WhitePaper_BigData.pdf.
  2. M. H. Hagan, H. B. Demuth, and M. H. Beale, Neural Network Design, PWS Publishing Company, 1996.
  3. J. Dean and S. Ghemawat, “MapReduce: simplified data processing on large clusters,” Communications of the ACM, vol. 51, no. 1, pp. 107–113, 2008. View at Publisher · View at Google Scholar · View at Scopus
  4. N. Almaadeed, A. Aggoun, and A. Amira, “Speaker identification using multimodal neural networks and wavelet analysis,” IET Biometrics, vol. 4, no. 1, pp. 18–28, 2015. View at Publisher · View at Google Scholar
  5. A. Chen and J. Ye, “Research on four-layer back propagation neural network for the computation of ship resistance,” in Proceedings of the IEEE International Conference on Mechatronics and Automation (ICMA '09), pp. 2537–2541, IEEE, Changchun, China, August 2009. View at Publisher · View at Google Scholar · View at Scopus
  6. N. L. D. Khoa, K. Sakakibara, and I. Nishikawa, “Stock price forecasting using back propagation neural networks with time and profit based adjusted weight factors,” in Proceedings of the International Joint Conference (SICE-ICASE '06), pp. 5484–5488, Busan, South Korea, October 2006. View at Publisher · View at Google Scholar · View at Scopus
  7. K. O. Stanley, D. B. D'Ambrosio, and J. Gauci, “A hypercube-based encoding for evolving large-scale neural networks,” Artificial Life, vol. 15, no. 2, pp. 185–212, 2009. View at Publisher · View at Google Scholar · View at Scopus
  8. F. Jin and G. Shu, “Back propagation neural network based on artificial bee colony algorithm,” in Proceedings of the 7th International Forum on Strategic Technology (IFOST '12), pp. 1–4, Tomsk, Russia, September 2012. View at Publisher · View at Google Scholar · View at Scopus
  9. Y. Li, Y. Fu, H. Li, and S.-W. Zhang, “The improved training algorithm of back propagation neural network with selfadaptive learning rate,” in Proceedings of the International Conference on Computational Intelligence and Natural Computing (CINC '09), pp. 73–76, IEEE, Wuhan, China, June 2009. View at Publisher · View at Google Scholar · View at Scopus
  10. J. Yuan and S. Yu, “Privacy preserving back-propagation neural network learning made practical with cloud computing,” IEEE Transactions on Parallel and Distributed Systems, vol. 25, no. 1, pp. 212–221, 2014. View at Publisher · View at Google Scholar
  11. Y.-H. Liu, S.-W. Luo, A.-J. Li, H. Huang, and J.-W. Wen, “Information geometry on extendable hierarchical large scale neural network model,” in Proceedings of the International Conference on Machine Learning and Cybernetics, vol. 3, pp. 1380–1384, November 2003. View at Scopus
  12. C. Oh and S. H. Zak, “Large-scale pattern storage and retrieval using generalized brain-state-in-a-box neural networks,” IEEE Transactions on Neural Networks, vol. 21, no. 4, pp. 633–643, 2010. View at Publisher · View at Google Scholar · View at Scopus
  13. Y. Fujimoto, N. Fukuda, and T. Akabane, “Massively parallel architectures for large scale neural network simulations,” IEEE Transactions on Neural Networks, vol. 3, no. 6, pp. 876–888, 1992. View at Publisher · View at Google Scholar · View at Scopus
  14. V. Kumar, A. Grama, A. Gupta, and G. Karypis, Introduction to Parallel Computing, Benjamin Cummings, Addison-Wesley, San Francisco, Calif, USA, 2002.
  15. Y. Liu, J. Yang, Y. Huang, L. Xu, S. Li, and M. Qi, “MapReduce based parallel neural networks in enabling large scale machine learning,” Computational Intelligence and Neuroscience, vol. 2015, Article ID 297672, 13 pages, 2015. View at Publisher · View at Google Scholar
  16. R. Gu, F. Shen, and Y. Huang, “A parallel computing platform for training large scale neural networks,” in Proceedings of the IEEE International Conference on Big Data (Big Data '13), pp. 376–384, IEEE, Silicon Valley, Calif, USA, October 2013. View at Publisher · View at Google Scholar · View at Scopus
  17. A. Hebboul, M. Hacini, and F. Hachouf, “An incremental parallel neural network for unsupervised classification,” in Proceedings of the 7th International Workshop on Systems, Signal Processing and their Applications (WoSSPA '11), pp. 400–403, IEEE, Tipaza, Algeria, May 2011. View at Publisher · View at Google Scholar · View at Scopus
  18. K. Ganeshamoorthy and D. N. Ranasinghe, “On the performance of parallel neural network implementations on distributed memory architectures,” in Proceedings of the 8th IEEE International Symposium on Cluster Computing and the Grid (CCGRID '08), pp. 90–97, Lyon, France, May 2008. View at Publisher · View at Google Scholar · View at Scopus
  19. Message Passing Interface, 2015, http://www.mcs.anl.gov/research/projects/mpi/.
  20. J. D. J. Rubio, R. Silva Ortigoza, F. J. Avila, A. Melendez, and J. M. Stein, “A fuzzy inference system for the identification,” IEEE Latin America Transactions, vol. 13, no. 9, pp. 2823–2829, 2015. View at Publisher · View at Google Scholar
  21. M. R. Cogollo and J. D. Velasquez, “Are neural networks able to forecast nonlinear time series with moving average components?” IEEE Latin America Transactions, vol. 13, no. 7, pp. 2292–2300, 2015. View at Publisher · View at Google Scholar
  22. Y. Liu, M. Li, M. Khan, and M. Qi, “A MapReduce based distributed LSI for scalable information retrieval,” Computing and Informatics, vol. 33, no. 2, pp. 259–280, 2014. View at Google Scholar · View at Scopus
  23. M. Héctor, R. Ugalde, J.-C. Carmona, V. M. Alvarado, J. Reyes-Reyes, and J. Mantilla, “Computational cost improvement of neural network models in black box nonlinear system identification,” Neurocomputing, vol. 166, pp. 96–108, 2015. View at Publisher · View at Google Scholar
  24. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, “Extreme learning machine: theory and applications,” Neurocomputing, vol. 70, no. 1–3, pp. 489–501, 2006. View at Publisher · View at Google Scholar
  25. Apache Hadoop, 2015, http://hadoop.apache.org/.
  26. P. C. Zikopoulos, C. Eaton, D. deRoos, T. Deutsch, and G. Lapis, Understanding Big Data, Analytics for Enterprise Class Hadoop and Streaming Data, McGraw-Hill, 2012.
  27. J. Venner, Pro Hadoop, Springer, New York, NY, USA, 2009.
  28. K. A. Nasullah, Parallelizing support vector machines for scalable image annotation [Ph.D. thesis], Brunel University, Uxbridge, UK, 2011.
  29. X. Liu, J. Wang, M. Yin, B. Edwards, and P. Xu, “Supervised learning of sparse context reconstruction coefficients for data representation and classification,” Neural Computing and Applications, 2015. View at Publisher · View at Google Scholar
  30. J. de Jesús Rubio, F. Ortiz-Rodriguez, C. R. Mariaca-Gaspar, and J. C. Tovar, “A method for online pattern recognition of abnormal eye movements,” Neural Computing and Applications, vol. 22, no. 3-4, pp. 597–605, 2013. View at Publisher · View at Google Scholar · View at Scopus
  31. The Iris Dataset, 2015, https://archive.ics.uci.edu/ml/datasets/Iris.
  32. The Wine Dataset, 2015, https://archive.ics.uci.edu/ml/datasets/wine.
  33. Delta elevators dataset, 2016, http://www.dcc.fc.up.pt/~ltorgo/Regression/delta_elevators.html.
  34. Spark, 2016, http://spark.apache.org/.