A Decentralized Partially Observable Markov Decision Model with Action Duration for Goal Recognition in Real Time Strategy Games

<table class="figure-group"><tr class="fig-image" id="a"><td><object data="https://static.hindawi.com/articles/ddns/volume-2017/4580206/figures/4580206.fig.002a.svgz" name="4580206.fig.002a" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(a) </b>Full dependency</td></tr><tr class="fig-image" id="b"><td><object data="https://static.hindawi.com/articles/ddns/volume-2017/4580206/figures/4580206.fig.002b.svgz" name="4580206.fig.002b" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(b) </b>Dependency when <svg height="11.927pt" id="M102" style="vertical-align:-3.291101pt" version="1.1" viewbox="-0.0498162 -8.6359 41.4607 11.927" width="41.4607pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M673 297H417L411 270C517 261 522 258 506 183L487 92C476 38 428 19 360 19C207 19 123 132 123 287C123 472 243 631 441 631C557 631 617 583 617 469L647 472C650 545 655 604 658 632C625 643 554 666 467 666C201 666 23 502 23 278C23 90 156 -16 339 -16C410 -16 501 6 569 24C566 43 567 70 573 101L589 183C604 259 607 262 667 271L673 297Z" id="g113-72"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="684" vert-adv-y="684" xpluscharwidth="8.892"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,8.501,0)"><path d="M593 650H142L136 622C219 616 224 611 209 531L130 120C114 39 108 34 23 28L17 0H501C518 32 557 130 568 158L540 169C519 132 495 93 469 70C439 43 409 35 332 35C272 35 241 37 225 50C211 61 211 89 222 149L253 320H350C441 320 443 312 441 239H471L510 434H481C455 366 448 358 360 358H260L303 572C311 613 312 615 348 615H431C509 615 522 603 532 581C544 555 546 531 545 491L574 493C583 555 592 631 593 650Z" id="g113-70"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="616" vert-adv-y="616" xpluscharwidth="16.509"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,16.444,3.132)"><path d="M329 433H203L239 587L230 596L147 534L123 433H57L30 395L34 388H115L61 129C37 16 59 -12 85 -12C147 -12 222 58 260 98L241 125C212 95 160 62 144 62C132 62 127 71 138 126L192 386L305 394L329 433Z" id="g50-117"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="347" vert-adv-y="347" xpluscharwidth="19.60168959"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,23.743,0)"><path d="M535 323V373H52V323H535ZM535 138V188H52V138H535Z" id="g117-34"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="587" vert-adv-y="587" xpluscharwidth="31.374"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,35.006,0)"><path d="M241 635C89 635 35 457 35 312C35 153 89 -12 240 -12C390 -12 443 166 443 312C443 466 390 635 241 635ZM238 602C329 602 354 454 354 312C354 172 330 22 240 22C152 22 124 173 124 313S148 602 238 602Z" id="g113-49"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="480" vert-adv-y="480" xpluscharwidth="41.246"></glyph.data></g></svg></td></tr><tr class="fig-image" id="c"><td><object data="https://static.hindawi.com/articles/ddns/volume-2017/4580206/figures/4580206.fig.002c.svgz" name="4580206.fig.002c" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(c) </b>Dependency when <svg height="11.927pt" id="M103" style="vertical-align:-3.291101pt" version="1.1" viewbox="-0.0498162 -8.6359 41.4607 11.927" width="41.4607pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M673 297H417L411 270C517 261 522 258 506 183L487 92C476 38 428 19 360 19C207 19 123 132 123 287C123 472 243 631 441 631C557 631 617 583 617 469L647 472C650 545 655 604 658 632C625 643 554 666 467 666C201 666 23 502 23 278C23 90 156 -16 339 -16C410 -16 501 6 569 24C566 43 567 70 573 101L589 183C604 259 607 262 667 271L673 297Z" id="g113-72"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="684" vert-adv-y="684" xpluscharwidth="8.892"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,8.501,0)"><path d="M593 650H142L136 622C219 616 224 611 209 531L130 120C114 39 108 34 23 28L17 0H501C518 32 557 130 568 158L540 169C519 132 495 93 469 70C439 43 409 35 332 35C272 35 241 37 225 50C211 61 211 89 222 149L253 320H350C441 320 443 312 441 239H471L510 434H481C455 366 448 358 360 358H260L303 572C311 613 312 615 348 615H431C509 615 522 603 532 581C544 555 546 531 545 491L574 493C583 555 592 631 593 650Z" id="g113-70"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="616" vert-adv-y="616" xpluscharwidth="16.509"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,16.444,3.132)"><path d="M329 433H203L239 587L230 596L147 534L123 433H57L30 395L34 388H115L61 129C37 16 59 -12 85 -12C147 -12 222 58 260 98L241 125C212 95 160 62 144 62C132 62 127 71 138 126L192 386L305 394L329 433Z" id="g50-117"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="347" vert-adv-y="347" xpluscharwidth="19.60168959"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,23.743,0)"><path d="M535 323V373H52V323H535ZM535 138V188H52V138H535Z" id="g117-34"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="587" vert-adv-y="587" xpluscharwidth="31.374"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,35.006,0)"><path d="M384 0V27C293 34 287 42 287 114V635C232 613 172 594 109 583V559L157 557C201 555 205 550 205 499V114C205 42 199 34 109 27V0H384Z" id="g113-50"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="480" vert-adv-y="480" xpluscharwidth="41.246"></glyph.data></g></svg></td></tr></table>

Discrete Dynamics in Nature and Society

fig2

Figure 2

Figure 2: A Decentralized Partially Observable Markov Decision Model with Action Duration for Goal Recognition in Real Time Strategy Games 