Table of Contents Author Guidelines Submit a Manuscript
Mobile Information Systems
Volume 2017, Article ID 3824765, 12 pages
https://doi.org/10.1155/2017/3824765
Research Article

A Parallel Strategy for Convolutional Neural Network Based on Heterogeneous Cluster for Mobile Information System

1School of Computer and Technology, Hangzhou Dianzi University, Hangzhou 310018, China
2Key Laboratory of Complex Systems Modeling and Simulation, Ministry of Education, Hangzhou, China
3College of Electrical Engineering, Zhejiang University, Hangzhou 310058, China
4School of Information and Electronic Engineering, Zhejiang University of Science & Technology, Hangzhou 310023, China
5Zhejiang Provincial Engineering Center on Media Data Cloud Processing and Analysis, Hangzhou, Zhejiang, China
6College of Computer Science and Technology, Zhejiang University, Hangzhou 310018, China

Correspondence should be addressed to Jian Wan; nc.ude.udh@naijnaw

Received 25 January 2017; Accepted 23 February 2017; Published 21 March 2017

Academic Editor: Jaegeol Yim

Copyright © 2017 Jilin Zhang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. P. Racherla, C. Furner, and J. Babb, “Conceptualizing the implications of mobile app usage and stickiness: a research agenda,” 2012.
  2. M. Gençer, G. Bilgin, Ö. Zan, and T. Voyvodaoglu, “A new framework for increasing user engagement in mobile applications using machine learning techniques,” in Proceedings of the International Conference on Design, User Experience, and Usability, pp. 651–659, Springer, Las Vegas, Nev, USA, 2013.
  3. B. B. Le Cun, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel, “Handwritten digit recognition with a back-propagation network,” in Advances in Neural Information Processing Systems, pp. 396–404, 1990. View at Google Scholar
  4. S. Lawrence, C. L. Giles, A. C. Tsoi, and A. D. Back, “Face recognition: a convolutional neural-network approach,” IEEE Transactions on Neural Networks, vol. 8, no. 1, pp. 98–113, 1997. View at Publisher · View at Google Scholar · View at Scopus
  5. D. Ciregan, U. Meier, and J. Schmidhuber, “Multi-column deep neural networks for image classification,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '12), pp. 3642–3649, Providence, RI, USA, June 2012. View at Publisher · View at Google Scholar · View at Scopus
  6. D. Cireşan, U. Meier, J. Masci, and J. Schmidhuber, “Multi-column deep neural network for traffic sign classification,” Neural Networks, vol. 32, pp. 333–338, 2012. View at Publisher · View at Google Scholar · View at Scopus
  7. J. Fan, W. Xu, Y. Wu, and Y. Gong, “Human tracking using convolutional neural networks,” IEEE Transactions on Neural Networks, vol. 21, no. 10, pp. 1610–1623, 2010. View at Publisher · View at Google Scholar · View at Scopus
  8. B. Babenko, M.-H. Yang, and S. Belongie, “Robust object tracking with online multiple instance learning,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 8, pp. 1619–1632, 2011. View at Publisher · View at Google Scholar · View at Scopus
  9. S. Naji, R. Zainuddin, S. A. Kareem, and H. A. Jalab, “Detecting faces in colored images using multi-skin color models and neural network with texture analysis,” Malaysian Journal of Computer Science, vol. 26, no. 2, pp. 101–123, 2013. View at Google Scholar · View at Scopus
  10. N. Rajput, P. Jain, and S. Shrivastava, “Face detection using HMM-SVM method,” in Advances in Computer Science, Engineering & Applications, pp. 835–842, Springer, Berlin, Germany, 2012. View at Google Scholar
  11. Y. Sun, X. Wang, and X. Tang, “Deep convolutional network cascade for facial point detection,” in Proceedings of the 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR '13), pp. 3476–3483, IEEE, Portland, Ore, USA, June 2013. View at Publisher · View at Google Scholar · View at Scopus
  12. Y. Wen, Y. Lu, J. Yan, Z. Zhou, K. M. Von Deneen, and P. Shi, “An algorithm for license plate recognition applied to intelligent transportation system,” IEEE Transactions on Intelligent Transportation Systems, vol. 12, no. 3, pp. 830–845, 2011. View at Publisher · View at Google Scholar · View at Scopus
  13. D. V. Phạm, “Online handwriting recognition using multi convolution neural networks,” in Proceedings of the Asia-Pacific Conference on Simulated Evolution and Learning, pp. 310–319, Springer, Hanoi, Vietnam, 2012.
  14. S. S. Ahranjany, F. Razzazi, and M. H. Ghassemian, “A very high accuracy handwritten character recognition system for Farsi/Arabic digits using convolutional neural networks,” in Proceedings of the IEEE 5th International Conference on Bio-Inspired Computing: Theories and Applications (BIC-TA '10), pp. 1585–1592, IEEE, Changsha, China, September 2010. View at Publisher · View at Google Scholar · View at Scopus
  15. A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet classification with deep convolutional neural networks,” in Proceedings of the 26th Annual Conference on Neural Information Processing Systems (NIPS '12), pp. 1097–1105, December 2012. View at Scopus
  16. C. Szegedy, W. Liu, Y. Jia et al., “Going deeper with convolutions,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '15), pp. 1–9, Boston, Mass, USA, June 2015. View at Publisher · View at Google Scholar · View at Scopus
  17. A. Krizhevsky, “One weird trick for parallelizing convolutional neural networks,” https://arxiv.org/abs/1404.5997.
  18. Y. Jia, E. Shelhamer, J. Donahue et al., “Caffe: Convolutional architecture for fast feature embedding,” in Proceedings of the ACM Conference on Multimedia (MM '14), pp. 675–678, November 2014. View at Publisher · View at Google Scholar · View at Scopus
  19. J. Yin, X. Lu, C. Pu, Z. Wu, and H. Chen, “JTangCSB: a cloud service bus for cloud and enterprise application integration,” IEEE Internet Computing, vol. 19, no. 1, pp. 35–43, 2015. View at Publisher · View at Google Scholar · View at Scopus
  20. D. Povey, A. Ghoshal, G. Boulianne et al., “The Kaldi speech recognition toolkit,” in Proceedings of the IEEE 2011 Workshop on Automatic Speech Recognition and Understanding (No. EPFL-CONF-192584), IEEE Signal Processing Society, Waikoloa, Hawaii, USA, 2011.
  21. Q. Ho, J. Cipar, H. Cui et al., “More effective distributed ML via a stale synchronous parallel parameter server,” in Advances in Neural Information Processing Systems, pp. 1223–1231, 2013. View at Google Scholar
  22. C. Farabet, B. Martini, P. Akselrod, S. Talay, Y. LeCun, and E. Culurciello, “Hardware accelerated convolutional neural networks for synthetic vision systems,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '10), pp. 257–260, IEEE, Paris, France, May-June 2010. View at Publisher · View at Google Scholar · View at Scopus
  23. R. Hemalatha, N. Santhiyakumari, and S. Suresh, “Implementation of medical image segmentation using Virtex FPGA kit,” in Proceedings of the 4th International Conference on Signal Processing and Communication Engineering Systems (SPACES '15), pp. 358–362, January 2015. View at Publisher · View at Google Scholar · View at Scopus
  24. J. G. Pandey, A. Karmakar, and S. Gurunarayanan, “Architectures and algorithms for image and video processing using FPGA-based platform,” in Proceedings of the 18th International Symposium on VLSI Design and Test (VDAT '14), July 2014. View at Publisher · View at Google Scholar · View at Scopus
  25. E. C. Pedrino, O. Morandin Jr., E. R. R. Kato, and V. O. Roda, “Intelligent FPGA based system for shape recognition,” in Proceedings of the 7th Southern Conference on Programmable Logic (SPL '11), pp. 197–202, IEEE, Córdoba, Spain, April 2011. View at Publisher · View at Google Scholar · View at Scopus
  26. A. Zawadzki and M. Gorgoń, “Automatically controlled pan-tilt smart camera with FPGA based image analysis system dedicated to real-time tracking of a moving object,” Journal of Systems Architecture, vol. 61, no. 10, pp. 681–692, 2015. View at Publisher · View at Google Scholar · View at Scopus
  27. T. Nakamura, Y. Touma, H. Hagiwara, K. Asami, and M. Komori, “Scene recognition based on gradient feature for autonomous mobile robot and its FPGA implementation,” in Proceedings of the 4th International Conference on Informatics, Electronics and Vision (ICIEV '15), pp. 1–4, IEEE Computer Society, Kitakyushu, Japan, June 2015.
  28. L. Idkhajine, E. Monmasson, and A. Maalouf, “Fully FPGA-based sensorless control for synchronous AC drive using an extended Kalman filter,” IEEE Transactions on Industrial Electronics, vol. 59, no. 10, pp. 3908–3918, 2012. View at Publisher · View at Google Scholar · View at Scopus
  29. S. Narjess, T. Ramzi, and M. M. Faouzi, “Implementation of sensorless control of an induction motor on FPGA using Xilinx system generator,” Journal of Theoretical & Applied Information Technology, vol. 92, no. 2, pp. 322–334, 2016. View at Google Scholar
  30. K. Yu, “Large-scale deep learning at Baidu,” in Proceedings of the the 22nd ACM International Conference, pp. 2211–2212, ACM, San Francisco, Calif, USA, October 2013. View at Publisher · View at Google Scholar
  31. A. Coates, “Deep learning with COTS HPC systems,” in Proceedings of the International Conference on Machine Learning (ICML '13), pp. 1337–1345, Atlanta, Ga, USA, 2013.
  32. O. Yadan, K. Adams, Y. Taigman, and M. A. Ranzato, “Multi-GPU training of convnets,” https://arxiv.org/abs/1312.5853.
  33. R. Uetz and S. Behnke, “Large-scale object recognition with CUDA-accelerated hierarchical neural networks,” in Proceedings of the IEEE International Conference on Intelligent Computing and Intelligent Systems (ICIS '09), vol. 1, pp. 536–541, IEEE, Shanghai, China, November 2009. View at Publisher · View at Google Scholar · View at Scopus
  34. D. C. Cireşan, U. Meier, J. Masci, L. M. Gambardella, and J. Schmidhuber, “Flexible, high performance convolutional neural networks for image classification,” in Proceedings of the 22nd International Joint Conference on Artificial Intelligence (IJCAI '11), pp. 1237–1242, July 2011. View at Publisher · View at Google Scholar · View at Scopus
  35. Z. Liu, H. Li, and G. Miao, “MapReduce-based backpropagation neural network over large scale mobile data,” in Proceedings of the 6th International Conference on Natural Computation (ICNC '10), vol. 4, pp. 1726–1730, IEEE, Yantai, China, August 2010. View at Publisher · View at Google Scholar · View at Scopus
  36. Q. Wang, J. Zhao, D. Gong, Y. Shen, M. Li, and Y. Lei, “Parallelizing convolutional neural networks for action event recognition in surveillance videos,” International Journal of Parallel Programming, 2016. View at Publisher · View at Google Scholar · View at Scopus
  37. Q. V. Le, “Building high-level features using large scale unsupervised learning,” in Proceedings of the 38th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '13), pp. 8595–8598, Vancouver, Canada, May 2013. View at Publisher · View at Google Scholar · View at Scopus
  38. J. Dean, G. Corrado, R. Monga et al., “Large scale distributed deep networks,” in Advances in Neural Information Processing Systems, pp. 1223–1231, 2012. View at Google Scholar