Table of Contents Author Guidelines Submit a Manuscript
The Scientific World Journal
Volume 2014 (2014), Article ID 398235, 16 pages
http://dx.doi.org/10.1155/2014/398235
Research Article

Risk Intelligence: Making Profit from Uncertainty in Data Processing System

School of Computer, National University of Defense Technology, China

Received 27 February 2014; Accepted 19 March 2014; Published 24 April 2014

Academic Editors: N. Barsoum, V. N. Dieu, P. Vasant, and G.-W. Weber

Copyright © 2014 Si Zheng et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. K. V. Vishwanath and N. Nagappan, “Characterizing cloud computing hardware reliability,” in Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC '10), pp. 193–203, Citeseer, June 2010. View at Publisher · View at Google Scholar · View at Scopus
  2. P. Gill, N. Jain, and N. Nagappan, “Understanding network failures in data centers: measurement, analysis, and implications,” ACM SIGCOMM Computer Communication Review, vol. 41, no. 4, pp. 350–361, 2011. View at Google Scholar
  3. Q. Zheng, “Improving MapReduce fault tolerance in the cloud,” in Proceedings of the IEEE International Symposium on Parallel and Distributed Processing, Workshops and Phd Forum (IPDPSW '10), pp. 1–6, IEEE, April 2010. View at Publisher · View at Google Scholar · View at Scopus
  4. Q. Zhang, L. Cheng, and R. Boutaba, “Cloud computing: state-of-the-art and research challenges,” Journal of Internet Services and Applications, vol. 1, no. 1, pp. 7–18, 2010. View at Publisher · View at Google Scholar · View at Scopus
  5. J. Dean and S. Ghemawat, “MapReduce: simplified data processing on large clusters,” Communications of the ACM, vol. 51, no. 1, pp. 107–113, 2008. View at Publisher · View at Google Scholar · View at Scopus
  6. M. Zaharia, A. Konwinski, A. Joseph, R. Katz, and I. Stoica, “Improving mapreduce performance in heterogeneous environments,” in Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation, pp. 29–42, 2008.
  7. G. Ananthanarayanan, S. Kandula, A. Greenberg et al., “Reining in the outliers in map-reduce clusters using mantri,” in Proceedings of the 9th USENIX Conference on Operating Systems Design and Implementation, pp. 1–16, USENIX Association, 2010.
  8. B. Hindman, A. Konwinski, M. Zaharia et al., “Mesos: a platform for fine-grained resource sharing in the data center,” in Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation, pp. 22–22, USENIX Association, 2011.
  9. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, “Dryad: distributed data-parallel programs from sequential building blocks,” ACM SIGOPS Operating Systems Review, vol. 41, no. 3, pp. 59–72, 2007. View at Google Scholar
  10. M. Zaharia, M. Chowdhury, M. Franklin, S. Shenker, and I. Stoica, “Spark: cluster computing with working sets,” in Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing, pp. 10–10, USENIX Association, 2010.
  11. A. Snavely, N. Wolter, and L. Carrington, “Modeling application performance by convolving machine signatures with application profiles,” in Proceedings of the IEEE International Workshop on Workload Characterization (WWC-4 '01), pp. 149–156, IEEE, 2001.
  12. R. Uhlig, G. Neiger, D. Rodgers et al., “Intel virtualization technology,” Computer, vol. 38, no. 5, pp. 48–56, 2005. View at Publisher · View at Google Scholar · View at Scopus
  13. P. Jalote, Fault Tolerance in Distributed Systems, Prentice-Hall, 1994.
  14. A. Salman, I. Ahmad, and S. Al-Madani, “Particle swarm optimization for task assignment problem,” Microprocessors and Microsystems, vol. 26, no. 8, pp. 363–371, 2002. View at Publisher · View at Google Scholar · View at Scopus
  15. M. Frank and P. Wolfe, “An algorithm for quadratic programming,” Naval Research Logistics Quarterly, vol. 3, no. 1-2, pp. 95–110, 2006. View at Google Scholar
  16. R. Jain, D. Chiu, and W. Hawe, A Quantitative Measure of Fairness and Discrimination for Resource Allocation in Shared Computer System, Eastern Research Laboratory, Digital Equipment Corporation, 1984.
  17. S. Balsamo, A. Di Marco, P. Inverardi, and M. Simeoni, “Model-based performance prediction in software development: a survey,” IEEE Transactions on Software Engineering, vol. 30, no. 5, pp. 295–310, 2004. View at Publisher · View at Google Scholar · View at Scopus
  18. L. Kleinrock, Queueing Systems. Volume 1: Theory, Wiley-Interscience, 1975.
  19. E. Lazowska, J. Zahorjan, G. Graham, and K. Sevcik, Quantitative System Performance: Computer System Analysis Using Queueing Network Models, Prentice-Hall, 1984.
  20. K. Kant and M. Srinivasan, Introduction to Computer System Performance Evaluation, McGraw-Hill College, 1992.
  21. K. Trivedi, Probability and Statistics with Reliability, Queuing, and Computer Science Applications, Wiley, New York, NY, USA, 2002.
  22. J. Banks and J. Carson, Event System Simulation, Prentice-Hall, 1984.
  23. M. Marsan, G. Balbo, and G. Conte, Performance Models of Multiprocessor Systems, MIT Press, 1986.
  24. F. Baccelli, G. Balbo, R. Boucherie, J. Campos, and G. Chiola, “Annotated bibliography on stochastic petri nets,” in Performance Evaluation of Parallel and Distributed Systems Solution Methods, vol. 105, CWI Tract, 1994. View at Google Scholar
  25. M. Harchol-Balter, “Task assignment with unknown duration,” Journal of the ACM, vol. 49, no. 2, pp. 260–288, 2002. View at Publisher · View at Google Scholar · View at Scopus
  26. D. W. Pentico, “Assignment problems: a golden anniversary survey,” European Journal of Operational Research, vol. 176, no. 2, pp. 774–793, 2007. View at Publisher · View at Google Scholar · View at Scopus
  27. C. Shen and W. Tsai, “A graph matching approach to optimal task assignment in distributed computing systems using a minimax criterion,” IEEE Transactions on Computers, vol. 100, no. 3, pp. 197–203, 1985. View at Google Scholar
  28. M. Harchol-Balter, M. E. Crovella, and C. D. Murta, “On choosing a task assignment policy for a distributed server system,” Journal of Parallel and Distributed Computing, vol. 59, no. 2, pp. 204–228, 1999. View at Publisher · View at Google Scholar · View at Scopus
  29. R. I. Davis and A. Burns, “A survey of hard real-time scheduling for multiprocessor systems,” ACM Computing Surveys, vol. 43, no. 4, article 35, 2011. View at Publisher · View at Google Scholar · View at Scopus
  30. Y. Jiang, X. Shen, J. Chen, and R. Tripathi, “Analysis and approximation of optimal co-scheduling on chip multiprocessors,” in Proceedings of the 17th International Conference on Parallel Architectures and Compilation Techniques (PACT '08), pp. 220–229, ACM, October 2008. View at Publisher · View at Google Scholar · View at Scopus
  31. R. Bunt, D. Eager, G. Oster, and C. Williamson, “Achieving load balance and effective caching in clustered web servers,” in Proceedings of the 4th International Web Caching Workshop, April 1999.
  32. P. B. Godfrey and I. Stoica, “Heterogeneity and load balance in distributed hash tables,” in Proceedings of the IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM '05), vol. 1, pp. 596–606, IEEE, March 2005. View at Scopus
  33. M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, and I. Stoica, “Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling,” in Proceedings of the 5th European Conference on Computer Systems (EuroSys '10), pp. 265–278, ACM, April 2010. View at Publisher · View at Google Scholar · View at Scopus
  34. http://wiki.apache.org/hadoop/WordCount.
  35. A. Verma, L. Cherkasova, and R. H. Campbell, “ARIA: automatic resource inference and allocation for mapreduce environments,” in Proceedings of the 8th ACM International Conference on Autonomic Computing, pp. 235–244, ACM, June 2011. View at Publisher · View at Google Scholar · View at Scopus
  36. J. de Leeuw and S. Pruzansky, “A new computational method to fit the weighted euclidean distance model,” Psychometrika, vol. 43, no. 4, pp. 479–490, 1978. View at Publisher · View at Google Scholar · View at Scopus
  37. http://hadoop.apache.org/docs/mapreduce/current/gridmix.html.