Research Article

Constructing Temporally Extended Actions through Incremental Community Detection

Figure 5

Modularity changes of incremental-option learning in small-scale Pac-Man problem. Comparison of the presented rule-based revision method with iteratively calling Louvain algorithm. Shadow areas denote standard deviation value.
(a) Modularity changes in Pac-Directional
(b) Modularity changes in Pac-Random