Kernel Recursive Least-Squares Temporal Difference Algorithms with Sparsification and Regularization

<table class="figure-group"><tr class="fig-image" id="a"><td><object data="https://static.hindawi.com/articles/cin/volume-2016/2305854/figures/2305854.fig.006a.svgz" name="2305854.fig.006a" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(a) </b>In the nonnoise chain</td></tr><tr class="fig-image" id="b"><td><object data="https://static.hindawi.com/articles/cin/volume-2016/2305854/figures/2305854.fig.006b.svgz" name="2305854.fig.006b" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(b) </b>In the noise chain</td></tr></table>

<div>Effect of the sliding-window size <svg height="8.68572pt" id="M516" style="vertical-align:-0.0498209pt" version="1.1" viewbox="-0.0498162 -8.6359 12.9526 8.68572" width="12.9526pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M962 650H795L470 145L347 650H176L170 622C268 613 275 606 244 503L190 322C150 188 132 126 118 91C102 50 80 33 18 28L12 0H245L251 28C175 35 170 48 174 93C177 128 191 180 220 284L292 542H294C331 392 383 150 409 4H432L774 555H776L714 137C700 40 694 34 612 28L606 0H868L874 28C793 34 784 37 797 137L849 533C859 612 863 616 956 622L962 650Z" id="g113-78"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="985" vert-adv-y="985"></glyph.data></g></svg> on three OSKRLSTD algorithms.</div>

Computational Intelligence and Neuroscience

fig6

Figure 6

Figure 6: Kernel Recursive Least-Squares Temporal Difference Algorithms with Sparsification and Regularization 