Hierarchical Sarsa Learning Based Route Guidance Algorithm

Algorithm 3

Procedure of Initialization.

begin

//Initializing Q-value of in each subnetwork

for  each   do

 Initialize According to Eq. (27) in the corresponding subnetwork

end for

//Initializing Q-value of in the higher level network

for  each   do

 Initialize According to Eq. (27) in the

end for

end