Constructing Temporally Extended Actions through Incremental Community Detection

Figure 4

Small-scale Pac-Man problem results. Comparison of the proposed incremental-option learning method with -learning with primitive actions and Louvain-option learning. Shadow areas denote standard deviation value.

(a) Learning curves of Pac-Directional

(b) Learning curves of Pac-Random