Efficient Actor-Critic Algorithm with Hierarchical Model Learning and Planning

Figure 2

Comparisons of different planning times and different algorithms.

(a) Determination of different planning times

(b) Comparisons of different algorithms in convergence performance