Deep Q-Network with Predictive State Models in Partially Observable Domains

Figure 1

The architecture of the RPSR-DQN network.