Hierarchical Sarsa Learning Based Route Guidance Algorithm

Algorithm 2

Overall procedure of Hierarchical Sarsa Learning based route guidance algorithm.

begin

//Initializing stage

Initialization routine

while not termination condition do

 while at updating interval do

  //Route Guidance stage

  Route Guidance routine

 end while

 //Updating stage

 Updating routine;

end while

end