Two-Phase Iteration for Value Function Approximation and Hyperparameter Optimization in Gaussian-Kernel-Based Adaptive Critic Design

<table class="figure-group"><tr class="fig-image" id="a"><td><object data="https://static.hindawi.com/articles/mpe/volume-2015/760459/figures/760459.fig.0011a.svgz" name="760459.fig.0011a" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(a) </b>Projecting on the dimensions of pole angle and cart displacement</td></tr><tr class="fig-image" id="b"><td><object data="https://static.hindawi.com/articles/mpe/volume-2015/760459/figures/760459.fig.0011b.svgz" name="760459.fig.0011b" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(b) </b>Projecting on the dimension of pole angle</td></tr></table>

<div>The <svg height="10.7866pt" id="M288" style="vertical-align:-2.150701pt" version="1.1" viewbox="-0.0498162 -8.6359 9.52083 10.7866" width="9.52083pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M699 368C699 549 574 666 407 666C186 666 23 488 23 277C23 113 129 -3 288 -13L307 -26C431 -111 501 -139 533 -147C559 -154 613 -163 658 -164L666 -141C597 -111 507 -66 430 -11L416 -1C580 42 699 190 699 368ZM601 371C601 227 518 54 381 22L354 40L278 24C175 47 120 145 120 269C120 451 235 631 398 631C540 631 601 521 601 371Z" id="g113-82"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="722" vert-adv-y="722"></glyph.data></g></svg> values w.r.t. all added samples over 100 runs.</div>

Mathematical Problems in Engineering

fig11

Figure 11

Figure 11: Two-Phase Iteration for Value Function Approximation and Hyperparameter Optimization in Gaussian-Kernel-Based Adaptive Critic Design 