Table of Contents Author Guidelines Submit a Manuscript
Wireless Communications and Mobile Computing
Volume 2019, Article ID 4807502, 12 pages
https://doi.org/10.1155/2019/4807502
Research Article

A Selective Mirrored Task Based Fault Tolerance Mechanism for Big Data Application Using Cloud

1School of Software Technology, Dalian University of Technology, Dalian, Liaoning, China
2Guangxi Key Laboratory of Hybrid Computation and IC Design Analysis, Guangxi University for Nationalities, Nanning, Guangxi, China

Correspondence should be addressed to Qinggeng Jin; moc.nuyila@gneggniqnij

Received 6 December 2018; Accepted 29 January 2019; Published 26 February 2019

Guest Editor: Salimur Choudhury

Copyright © 2019 Hao Wu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. M. Armbrust, A. Fox, R. Griffith et al., “A view of cloud computing,” Communications of the ACM, vol. 53, no. 4, pp. 50–58, 2010. View at Publisher · View at Google Scholar · View at Scopus
  2. Market Research Media, “Global cloud computing market forecast 2019-2024,” https://www.marketresearchmedia.com/?p=839. View at Publisher · View at Google Scholar
  3. L. F. Sikos, “Big data applications,” in Mastering Structured Data on the Semantic Web, 2015. View at Publisher · View at Google Scholar
  4. G.-H. Kim, S. Trimi, and J.-H. Chung, “Big-data applications in the government sector,” Communications of the ACM, vol. 57, no. 3, pp. 78–85, 2014. View at Publisher · View at Google Scholar · View at Scopus
  5. G. Wang, T. S. E. Ng, and A. Shaikh, “Programming your network at run-time for big data applications,” in Proceedings of the 1st ACM International Workshop on Hot Topics in Software Defined Networks (HotSDN '12), pp. 103–108, ACM, Helsinki, Finland, August 2012. View at Publisher · View at Google Scholar · View at Scopus
  6. P. Costa, A. Donnelly, A. Rowstron, and G. O’Shea, “Camdoop: Exploiting in-network aggregation for big data applications,” in Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation, USENIX Association, 2012.
  7. H. Liu, H. Ning, Y. Zhang, Q. Xiong, and L. T. Yang, “Role-dependent privacy preservation for secure V2G networks in the smart grid,” IEEE Transactions on Information Forensics and Security, vol. 9, no. 2, pp. 208–220, 2014. View at Publisher · View at Google Scholar · View at Scopus
  8. E. Sindrilaru, A. Costan, and V. Cristea, “Fault tolerance and recovery in grid workflow management systems,” in Proceedings of the 4th International Conference on Complex, Intelligent and Software Intensive Systems (CISIS '10), pp. 475–480, IEEE, February 2010. View at Scopus
  9. Q. Zheng, “Improving MapReduce fault tolerance in the cloud,” in Proceedings of the IEEE International Symposium on Parallel and Distributed Processing, Workshops and Phd Forum (IPDPSW '10), IEEE, April 2010. View at Scopus
  10. L. Peng et al., “Deep convolutional computation model for feature learning on big data in internet of things,” IEEE Transactions on Industrial Informatics, vol. 14, no. 2, pp. 790–798, 2018. View at Google Scholar
  11. Q. Zhang, L. T. Yang, Z. Yan, Z. Chen, and P. Li, “An efficient deep learning model to predict cloud workload for industry informatics,” IEEE Transactions on Industrial Informatics, vol. 14, no. 7, pp. 3170–3178, 2018. View at Publisher · View at Google Scholar · View at Scopus
  12. L. Man and L. T. Yang, “Hybrid genetic algorithms for scheduling partially ordered tasks in a multi-processor environment,” in Proceedings of the Sixth International Conference on Real-Time Computing Systems and Applications (RTCSA '99), IEEE, 1999.
  13. Q. Zhang, L. T. Yang, and Z. Chen, “Deep computation model for unsupervised feature learning on big data,” IEEE Transactions on Services Computing, vol. 9, no. 1, pp. 161–171, 2016. View at Google Scholar
  14. “Cluster networking in ec2,” https://amazonaws-china.com/ec2/instance-types.
  15. “Google cloud,” https://cloud.google.com/. View at Publisher · View at Google Scholar
  16. “Microsoft azure,” https://azure.microsoft.com/.
  17. J. Rao, Y. Wei, J. Gong, and C.-Z. Xu, “QoS guarantees and service differentiation for dynamic cloud applications,” IEEE Transactions on Network and Service Management, vol. 10, no. 1, pp. 43–55, 2013. View at Publisher · View at Google Scholar · View at Scopus
  18. J. Wentao, Z. Chunyuan, and F. Jian, “Device view redundancy: An adaptive low-overhead fault tolerance mechanism for many-core system,” in Proceedings of the IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing (HPCC_EUC '13), IEEE, 2013.
  19. M. Engelhardt and L. J. Bain, “On the mean time between failures for repairable systems,” IEEE Transactions on Reliability, vol. 35, no. 4, pp. 419–422, 1986. View at Publisher · View at Google Scholar · View at Scopus
  20. H. Akkary, R. Rajwar, and S. T. Srinivasan, “Checkpoint processing and recovery: towards scalable large instruction window processors,” in Proceedings of the 36th annual IEEE/ACM International Symposium on Microarchitecture, pp. 423–434, IEEE Computer Society, San Diego, Calif, USA, 2003. View at Publisher · View at Google Scholar
  21. J. W. Young, “A first order approximation to the optimum checkpoint interval,” Communications of the ACM, vol. 17, no. 9, pp. 530-531, 1974. View at Publisher · View at Google Scholar · View at Scopus
  22. J. T. Daly, “A higher order estimate of the optimum checkpoint interval for restart dumps,” Future Generation Computer Systems, vol. 22, no. 3, pp. 303–312, 2006. View at Publisher · View at Google Scholar · View at Scopus
  23. X. Zhu, J. Wang, H. Guo, D. Zhu, L. T. Yang, and L. Liu, “Fault-tolerant scheduling for real-time scientific workflows with elastic resource provisioning in virtualized clouds,” IEEE Transactions on Parallel and Distributed Systems, vol. 27, no. 12, pp. 3501–3517, 2016. View at Publisher · View at Google Scholar
  24. X. Qin and H. Jiang, “A novel fault-tolerant scheduling algorithm for precedence constrained tasks in real-time heterogeneous systems,” Parallel Computing. Systems & Applications, vol. 32, no. 5-6, pp. 331–356, 2006. View at Publisher · View at Google Scholar · View at MathSciNet
  25. S. Mu, M. Su, P. Gao, Y. Wu, K. Li, and A. Y. Zomaya, “Cloud storage over multiple data centers,” Handbook on Data Centers, pp. 691–725, 2015. View at Google Scholar · View at Scopus
  26. H. Topcuoglu, S. Hariri, and M. Wu, “Performance-effective and low-complexity task scheduling for heterogeneous computing,” IEEE Transactions on Parallel and Distributed Systems, vol. 13, no. 3, pp. 260–274, 2002. View at Publisher · View at Google Scholar · View at Scopus
  27. H. Wu, X. Hua, Z. Li, and S. Ren, “Resource and instance hour minimization for deadline constrained DAG applications using computer clouds,” IEEE Transactions on Parallel and Distributed Systems, vol. 27, no. 3, pp. 885–899, 2016. View at Publisher · View at Google Scholar · View at Scopus
  28. G. Juve, “workflowgenerator,” https://confluence.pegasus.isi.edu/display/pegasus/workflowgenerator, 2014.
  29. S. Bharathi, A. Chervenak, E. Deelman, G. Mehta, M. Su, and K. Vahi, “Characterization of scientific workflows,” in Proceedings of the 3rd Workshop on Workflows in Support of Large-Scale Science (WORKS '08), pp. 1–10, IEEE, November 2008. View at Publisher · View at Google Scholar · View at Scopus
  30. G. Juve, A. Chervenak, E. Deelman, S. Bharathi, G. Mehta, and K. Vahi, “Characterizing and profiling scientific workflows,” Future Generation Computer Systems, vol. 29, no. 3, pp. 682–692, 2013. View at Publisher · View at Google Scholar · View at Scopus