Table of Contents Author Guidelines Submit a Manuscript
The Scientific World Journal
Volume 2015, Article ID 545308, 9 pages
http://dx.doi.org/10.1155/2015/545308
Research Article

Composition of Web Services Using Markov Decision Processes and Dynamic Programming

Facultad de Matemáticas, Universidad Autónoma de Yucatán, Anillo Periférico Norte, Tablaje Cat. 13615, Apartado Postal 192, Colonia Chuburná Hidalgo Inn, 97119 Mérida, YUC, Mexico

Received 26 June 2014; Revised 17 September 2014; Accepted 14 October 2014

Academic Editor: Ahmad T. Azar

Copyright © 2015 Víctor Uc-Cetina et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. W3C Working Group, Web Services Architecture, 2004, http://www.w3.org/TR/ws-arch/.
  2. V. X. Tran and H. Tsuji, “QoS based ranking for web Services: fuzzy approaches,” in Proceedings of the 4th International Conference on Next Generation Web Services Practices (NWeSP '08), pp. 77–82, Seoul, Republic of Korea, October 2008. View at Publisher · View at Google Scholar · View at Scopus
  3. S.-Y. Hwang, E.-P. Lim, C.-H. Lee, and C.-H. Chen, “Dynamic Web service selection for reliable Web service composition,” IEEE Transactions on Services Computing, vol. 1, no. 2, pp. 104–116, 2008. View at Publisher · View at Google Scholar · View at Scopus
  4. D.-H. Shin, K.-H. Lee, and T. Suda, “Automated generation of composite web services based on functional semantics,” Journal of Web Semantics, vol. 7, no. 4, pp. 332–343, 2009. View at Publisher · View at Google Scholar · View at Scopus
  5. Y. Yan, P. Poizat, and L. Zhao, “Self-adaptive service composition through graphplan repair,” in Proceedings of the IEEE 8th International Conference on Web Services (ICWS '10), pp. 624–627, July 2010. View at Publisher · View at Google Scholar · View at Scopus
  6. W. Jiang, S. Hu, D. Lee, S. Gong, and Z. Liu, “Continuous query for QoS-aware automatic service composition,” in Proceedings of the IEEE 19th International Conference on Web Services (ICWS '12), pp. 50–57, Honolulu, Hawaii, USA, June 2012. View at Publisher · View at Google Scholar · View at Scopus
  7. Y. Feng, A. Veeramani, and R. Kanagasabai, “Automatic DAG-based service composition: a model checking approach,” in Proceedings of the IEEE 19th International Conference on Web Services (ICWS '12), June 2012. View at Publisher · View at Google Scholar · View at Scopus
  8. Y. Yan, M. Chen, and Y. Yang, “Anytime QoS optimization over the PlanGraph for web service composition,” in Proceedings of the 27th Annual ACM Symposium on Applied Computing (SAC '12), pp. 1968–1975, March 2012. View at Publisher · View at Google Scholar · View at Scopus
  9. L. Zeng, B. Benatallah, A. H. H. Ngu, M. Dumas, J. Kalagnanam, and H. Chang, “QoS-aware middleware for Web services composition,” IEEE Transactions on Software Engineering, vol. 30, no. 5, pp. 311–327, 2004. View at Publisher · View at Google Scholar · View at Scopus
  10. D. Ardagna and B. Pernici, “Adaptive service composition in flexible processes,” IEEE Transactions on Software Engineering, vol. 33, no. 6, pp. 369–384, 2007. View at Publisher · View at Google Scholar · View at Scopus
  11. T. Yu, Y. Zhang, and K.-J. Lin, “Efficient algorithms for Web services selection with end-to-end QoS constraints,” ACM Transactions on the Web, vol. 1, no. 1, article 6, 2007. View at Publisher · View at Google Scholar · View at Scopus
  12. S.-C. Oh, D. Lee, and S. R. T. Kumara, “Effective Web service composition in diverse and large-scale service networks,” IEEE Transactions on Services Computing, vol. 1, no. 1, pp. 15–32, 2008. View at Publisher · View at Google Scholar · View at Scopus
  13. Y. Bo and Q. Zheng, “Semantic web service composition using graphplan,” in Proceedings of the 4th IEEE Conference on Industrial Electronics and Applications (ICIEA '09), pp. 459–463, Xi'an, China, May 2009. View at Publisher · View at Google Scholar · View at Scopus
  14. P. Rodriguez-Mier, M. Mucientes, and M. Lama, “Automatic web service composition with a heuristic-based search algorithm,” in Proceedings of the IEEE 9th International Conference on Web Services (ICWS '11), pp. 81–88, July 2011. View at Publisher · View at Google Scholar · View at Scopus
  15. F. Qiqing, P. Xiaoming, L. Qinghua, and H. Yahui, “A global QoS optimizing web services selection algorithm based on MOACO for dynamic web service composition,” in Proceedings of the International Forum on Information Technology and Applications (IFITA '09), pp. 37–42, Chengdu, China, May 2009. View at Publisher · View at Google Scholar · View at Scopus
  16. M. Oh, J. Baik, S. Kang, and H.-J. Choi, “An efficient approach for QoS-aware service selection based on a tree-based algorithm,” in Proceedings of the 17th IEEE/ACIS International Conference on Computer and Information Science (ICIS '08), pp. 605–610, IEEE, Portland, Ore, USA, May 2008. View at Publisher · View at Google Scholar
  17. P. Doshi, R. Goodwin, R. Akkiraju, and K. Verma, “Dynamic workflow composition using Markov decision processes,” in Proceedings of the IEEE International Conference on Web Services (ICWS '04), pp. 576–582, July 2004. View at Publisher · View at Google Scholar · View at Scopus
  18. A. Gao, D. Yang, S. Tang, and M. Zhang, “Web service composition using Markov decision processes,” in Advances in Web-Age Information Management: Proceedings 6th International Conference, WAIM 2005, Hangzhou, China, October 11–13, 2005, vol. 3739 of Lecture Notes in Computer Science, pp. 308–319, Springer, Berlin, Germany, 2005. View at Publisher · View at Google Scholar
  19. J. Harney and P. Doshi, “Selective querying for adapting web service compositions using the value of changed information,” IEEE Transactions on Services Computing, vol. 1, no. 3, pp. 169–185, 2008. View at Publisher · View at Google Scholar · View at Scopus
  20. K. Chen, J. Xu, and S. Reiff-Marganiec, “Markov-HTN planning approach to enhance flexibility of automatic web service composition,” in Proceedings of the IEEE International Conference on Web Services (ICWS '09), pp. 9–16, Los Angeles, Calif, USA, July 2009. View at Publisher · View at Google Scholar · View at Scopus
  21. H. Wang, P. Tang, and P. Hung, “RLPLA: A reinforcement learning algorithm of web service composition with preference consideration,” in Proceedings of the IEEE Congress on Services Part II, 2008.
  22. H. Wang, X. Zhouy, X. Zhou, W. Liu, and W. Li, “Adaptive and dynamic service composition using Q-learning,” in Proceedings of the 22nd International Conference on Tools with Artificial Intelligence (ICTAI '10), pp. 145–152, Arras, France, October 2010. View at Publisher · View at Google Scholar · View at Scopus
  23. V. Todica, M.-F. Vaida, and M. Cremene, “Formal verification in web services composition,” in Proceedings of the 18th IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR '12), pp. 195–200, May 2012. View at Publisher · View at Google Scholar · View at Scopus
  24. L. Yu, W. Zhili, L. Meng, W. Jiang, and X.-S. Qiu, “Adaptive web services composition using Q-learning in cloud,” in Proceedings of the 9th IEEE World Congress on Services (SERVICES '13), pp. 393–396, Santa Clara, Calif, USA, July 2013. View at Publisher · View at Google Scholar · View at Scopus
  25. R. S. Sutton and A. G. Barto, Reinforcement Learning An Introduction, The MIT Press, Cambridge, Mass, USA, 1998.
  26. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming, Athena Scientific, 1996.
  27. M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley Series in Probability and Mathematical Statistics: Applied Probability and Statistics, Wiley-Interscience, 1994. View at MathSciNet
  28. S. Singh, T. Jaakkola, M. L. Littman, and C. Szepesvári, “Convergence results for single-step on-policy reinforcement-learning algorithms,” Machine Learning, vol. 38, no. 3, pp. 287–308, 2000. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  29. C. Watkins, Learning from delayed rewards [Ph.D. thesis], University of Cambridge, 1989.
  30. T. Jaakkola, M. I. Jordan, and S. Singh, “On the convergence of stochastic iterative dynamic programming algorithms,” Neural Computation, vol. 6, pp. 1185–1201, 1994. View at Publisher · View at Google Scholar