Composition of Web Services Using Markov Decision Processes and Dynamic Programming

Algorithm 2

Policy iteration algorithm.

(1) initialize randomly

(2) repeat

(3)  

(4)  foreach state do

(5)   

(6)  end

(7) until convergence