A Decentralized Partially Observable Markov Decision Model with Action Duration for Goal Recognition in Real Time Strategy Games

<table class="figure-group"><tr class="fig-image" id="a"><td><object data="https://static.hindawi.com/articles/ddns/volume-2017/4580206/figures/4580206.fig.008a.svgz" name="4580206.fig.008a" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(a) </b>Precision</td></tr><tr class="fig-image" id="b"><td><object data="https://static.hindawi.com/articles/ddns/volume-2017/4580206/figures/4580206.fig.008b.svgz" name="4580206.fig.008b" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(b) </b>Recall</td></tr><tr class="fig-image" id="c"><td><object data="https://static.hindawi.com/articles/ddns/volume-2017/4580206/figures/4580206.fig.008c.svgz" name="4580206.fig.008c" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(c) </b><svg height="8.68572pt" id="M296" style="vertical-align:-0.0498209pt" version="1.1" viewbox="-0.0498162 -8.6359 8.02022 8.68572" width="8.02022pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M584 650H137L131 622C214 614 217 612 200 521L125 127C109 41 101 35 23 28L17 0H288L294 28C201 35 193 42 209 128L242 309H348C440 309 442 300 443 226H471L510 422H482C452 354 449 348 357 348H251L295 575C302 609 304 615 338 615H426C502 615 517 604 526 581C534 560 536 524 537 492L565 494C574 554 583 631 584 650Z" id="g113-71"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="607" vert-adv-y="607" xpluscharwidth="7.891"></glyph.data></g></svg>-measure</td></tr></table>

<div>Three metrics of Dec-POMDM-T and Dec-POMDM (<svg height="14.1101pt" id="M295" style="vertical-align:-5.4742pt" version="1.1" viewbox="-0.0498162 -8.6359 56.1274 14.1101" width="56.1274pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M822 650H589L583 622C660 617 677 607 674 561C672 534 664 481 647 390L600 137H596L273 650H126L120 622C176 620 194 615 207 594C221 571 225 557 214 504L161 257C141 166 129 112 121 85C108 42 83 30 29 28L23 0H260L266 28C193 33 173 42 176 89C178 122 186 172 202 255L256 527H259L583 -8H612L690 390C708 481 720 535 728 558C744 603 756 619 816 622L822 650Z" id="g113-79"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="839" vert-adv-y="839" xpluscharwidth="10.907"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,10.062,3.132)"><path d="M573 302C573 402 527 451 414 451C386 451 343 446 313 437L330 513L320 522C295 508 261 484 243 463L230 415C194 400 159 383 126 359L131 330C159 344 187 357 222 368L109 -147C96 -204 80 -214 18 -223L13 -255L256 -244L259 -212L236 -210C184 -205 180 -195 191 -141L219 -1C240 -10 268 -12 284 -12C352 4 431 48 484 104C543 166 573 240 573 302ZM481 290C481 165 381 37 305 37C280 37 249 56 235 71L302 395C328 399 353 402 372 402C427 402 481 378 481 290Z" id="g50-113"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="597" vert-adv-y="597" xpluscharwidth="15.49468209"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,19.645,0)"><path d="M535 323V373H52V323H535ZM535 138V188H52V138H535Z" id="g117-34"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="587" vert-adv-y="587" xpluscharwidth="27.276"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,30.908,0)"><path d="M137 343C167 482 260 545 321 574C357 591 397 603 429 609L423 641C382 634 335 622 295 608C189 570 37 457 37 238C37 84 125 -12 242 -12C362 -12 447 89 447 209C447 311 374 393 267 393C247 393 226 386 204 376L137 343ZM227 337C318 337 361 256 361 173C361 105 336 22 258 22C176 22 126 120 126 240C126 266 127 291 132 310C155 323 189 337 227 337Z" id="g113-55"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="480" vert-adv-y="480" xpluscharwidth="37.148"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,37.148,0)"><path d="M241 635C89 635 35 457 35 312C35 153 89 -12 240 -12C390 -12 443 166 443 312C443 466 390 635 241 635ZM238 602C329 602 354 454 354 312C354 172 330 22 240 22C152 22 124 173 124 313S148 602 238 602Z" id="g113-49"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="480" vert-adv-y="480" xpluscharwidth="43.388000000000005"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,43.388,0)"><path d="M241 635C89 635 35 457 35 312C35 153 89 -12 240 -12C390 -12 443 166 443 312C443 466 390 635 241 635ZM238 602C329 602 354 454 354 312C354 172 330 22 240 22C152 22 124 173 124 313S148 602 238 602Z" id="g113-49"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="480" vert-adv-y="480" xpluscharwidth="49.628"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,49.628,0)"><path d="M241 635C89 635 35 457 35 312C35 153 89 -12 240 -12C390 -12 443 166 443 312C443 466 390 635 241 635ZM238 602C329 602 354 454 354 312C354 172 330 22 240 22C152 22 124 173 124 313S148 602 238 602Z" id="g113-49"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="480" vert-adv-y="480" xpluscharwidth="55.868"></glyph.data></g></svg>).</div>

Discrete Dynamics in Nature and Society

fig8

Figure 8

Figure 8: A Decentralized Partially Observable Markov Decision Model with Action Duration for Goal Recognition in Real Time Strategy Games 