[Retracted] Application Method of Environmental Protection Building Elements Based on Artificial Intelligence Technology in the Field of Urban Planning and Design
Algorithm 2
Experience pool storage algorithm.
Input Round sample
Task Store the round samples into the experience pool and calculate the advantage function
1 Obtain the length of round samples , super parameters and , the current capacity of experience pool length, and the maximum capacity of experience pool length_max
2 Initialization TD error , advantage function , cumulative return
3 for do
4
5
6
7 endfor
8 Obtain experience samples
9 Calculate the number of sample segments
10 Slice according to to get sample segment , and zero the sample segment with length less than
11 iflength+N>length_maxthen
12 Delete the last length+N-length_max sample segments from the end of the experience pool queue
