Kernel Temporal Differences for Neural Decoding

Figure 3

A -state Markov chain [33]. For states from to , the state transition probabilities are and the corresponding rewards are . State has state transition probability of to the terminal state and a reward of . States , , , and have the -dimensional state space representations , , , and , respectively. The representations of the other states are linear interpolations between the above vectors.