Two-Phase Iteration for Value Function Approximation and Hyperparameter Optimization in Gaussian-Kernel-Based Adaptive Critic Design

<div>The average evolution processes over 50 runs w.r.t. different <svg height="15.471pt" id="M188" style="vertical-align:-3.9435pt" version="1.1" viewbox="-0.0498162 -11.5275 11.4921 15.471" width="11.4921pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M471 401C471 442 455 448 440 448C421 448 389 439 366 424C314 390 233 331 165 242H163L187 345C193 372 197 393 197 409C197 435 189 448 174 448C146 448 80 408 23 349L40 327C64 351 97 373 107 373C115 373 118 366 111 337L29 -4L36 -12C56 -4 83 3 110 9C123 69 136 126 150 172C227 283 336 381 377 381C392 381 396 370 379 298L326 74C290 -77 273 -172 273 -197C273 -219 316 -261 346 -261L353 -246C348 -227 352 -174 374 -66L457 310C467 352 471 381 471 401Z" id="g113-229"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="494" vert-adv-y="494"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,6.423,-5.741)"><path d="M389 0V32C297 37 291 46 291 118V635C234 612 176 595 109 583V556L161 554C203 551 207 548 207 497V118C207 46 201 37 110 32V0H389Z" id="g58-47"></path><glyph.data ascent="1007" descent="-369" horiz-adv-x="487" vert-adv-y="487"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,6.097,3.784)"><path d="M329 433H203L239 587L230 596L147 534L123 433H57L30 395L34 388H115L61 129C37 16 59 -12 85 -12C147 -12 222 58 260 98L241 125C212 95 160 62 144 62C132 62 127 71 138 126L192 386L305 394L329 433Z" id="g50-117"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="347" vert-adv-y="347"></glyph.data></g></svg>.</div>

Mathematical Problems in Engineering

fig2

Figure 2

Figure 2: Two-Phase Iteration for Value Function Approximation and Hyperparameter Optimization in Gaussian-Kernel-Based Adaptive Critic Design 