A Decentralized Partially Observable Markov Decision Model with Action Duration for Goal Recognition in Real Time Strategy Games

<table class="figure-group"><tr class="fig-image" id="a"><td><object data="https://static.hindawi.com/articles/ddns/volume-2017/4580206/figures/4580206.fig.003a.svgz" name="4580206.fig.003a" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(a) </b>Full dependency</td></tr><tr class="fig-image" id="b"><td><object data="https://static.hindawi.com/articles/ddns/volume-2017/4580206/figures/4580206.fig.003b.svgz" name="4580206.fig.003b" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(b) </b>Dependency when <svg height="15.7176pt" id="M121" style="vertical-align:-3.9435pt" version="1.1" viewbox="-0.0498162 -11.7741 36.8936 15.7176" width="36.8936pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M483 97L471 123C436 91 401 65 392 65C388 65 384 74 390 106C414 239 444 378 457 429L455 433C444 433 429 436 416 439C392 444 368 448 344 448C281 448 204 415 152 376C71 315 23 205 23 103C23 21 57 -12 85 -12C114 -12 149 6 185 34C231 70 285 119 329 183H331L309 81C292 0 308 -12 326 -12C350 -12 421 24 483 97ZM374 387C370 363 356 291 345 261C315 193 181 50 139 50C124 50 110 71 110 118C110 224 153 331 218 379C238 394 271 402 301 402C329 402 359 394 374 387Z" id="g113-98"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="506" vert-adv-y="506" xpluscharwidth="6.578"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,6.58,0)"><path d="M391 364C391 409 353 448 295 448C249 448 198 426 152 393C65 331 23 225 23 139C23 14 96 -12 146 -12C198 -12 280 9 367 101L351 124C300 78 242 48 194 48C129 48 109 107 109 162V191C208 213 391 266 391 364ZM313 350C313 305 268 261 113 223C132 334 187 381 217 398C227 404 244 405 261 405C290 405 313 385 313 350Z" id="g113-102"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="414" vert-adv-y="414" xpluscharwidth="11.962"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,11.962,-5.741)"><path d="M250 606C250 634 233 656 203 656C168 656 146 618 146 593C146 564 169 545 192 545C227 545 250 573 250 606ZM227 95L212 119C187 98 152 71 135 71C129 71 128 78 134 102L207 373C219 418 217 451 194 451C165 451 92 411 30 351L44 326C77 353 106 371 114 371C124 371 121 357 117 341L55 97C32 5 46 -12 70 -12C108 -12 191 51 227 95Z" id="g50-106"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="280" vert-adv-y="280" xpluscharwidth="14.5099916"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,11.897,3.784)"><path d="M329 433H203L239 587L230 596L147 534L123 433H57L30 395L34 388H115L61 129C37 16 59 -12 85 -12C147 -12 222 58 260 98L241 125C212 95 160 62 144 62C132 62 127 71 138 126L192 386L305 394L329 433Z" id="g50-117"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="347" vert-adv-y="347" xpluscharwidth="15.05468959"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,19.197,0)"><path d="M535 323V373H52V323H535ZM535 138V188H52V138H535Z" id="g117-34"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="587" vert-adv-y="587" xpluscharwidth="26.828"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,30.46,0)"><path d="M241 635C89 635 35 457 35 312C35 153 89 -12 240 -12C390 -12 443 166 443 312C443 466 390 635 241 635ZM238 602C329 602 354 454 354 312C354 172 330 22 240 22C152 22 124 173 124 313S148 602 238 602Z" id="g113-49"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="480" vert-adv-y="480" xpluscharwidth="36.7"></glyph.data></g></svg> and <svg height="16.5292pt" id="M122" style="vertical-align:-3.597699pt" version="1.1" viewbox="-0.0498162 -12.9315 37.717 16.5292" width="37.717pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M483 97L471 123C436 91 401 65 392 65C388 65 384 74 390 106C414 239 444 378 457 429L455 433C444 433 429 436 416 439C392 444 368 448 344 448C281 448 204 415 152 376C71 315 23 205 23 103C23 21 57 -12 85 -12C114 -12 149 6 185 34C231 70 285 119 329 183H331L309 81C292 0 308 -12 326 -12C350 -12 421 24 483 97ZM374 387C370 363 356 291 345 261C315 193 181 50 139 50C124 50 110 71 110 118C110 224 153 331 218 379C238 394 271 402 301 402C329 402 359 394 374 387Z" id="g113-98"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="506" vert-adv-y="506" xpluscharwidth="6.578"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,6.58,0)"><path d="M391 364C391 409 353 448 295 448C249 448 198 426 152 393C65 331 23 225 23 139C23 14 96 -12 146 -12C198 -12 280 9 367 101L351 124C300 78 242 48 194 48C129 48 109 107 109 162V191C208 213 391 266 391 364ZM313 350C313 305 268 261 113 223C132 334 187 381 217 398C227 404 244 405 261 405C290 405 313 385 313 350Z" id="g113-102"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="414" vert-adv-y="414" xpluscharwidth="11.962"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,11.962,-6.899)"><path d="M400 606C400 634 383 656 353 656C316 656 294 620 294 593C294 564 317 545 343 545C375 545 400 573 400 606ZM366 351C379 413 381 451 356 451C323 451 251 408 183 341L199 313C223 335 267 365 277 365C285 365 284 354 277 312C245 132 222 27 193 -100C182 -148 160 -188 131 -188C113 -188 90 -178 75 -170C64 -164 55 -168 48 -175C38 -185 24 -203 24 -222S48 -257 71 -257C89 -257 131 -241 186 -192C243 -141 286 -46 310 74L366 351Z" id="g50-107"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="430" vert-adv-y="430" xpluscharwidth="15.8749871"></glyph.data></g><g transform="matrix(.0091,0,0,-0.0091,11.897,3.438)"><path d="M329 433H203L239 587L230 596L147 534L123 433H57L30 395L34 388H115L61 129C37 16 59 -12 85 -12C147 -12 222 58 260 98L241 125C212 95 160 62 144 62C132 62 127 71 138 126L192 386L305 394L329 433Z" id="g50-117"></path><glyph.data ascent="3443" descent="-2856" horiz-adv-x="347" vert-adv-y="347" xpluscharwidth="15.05468959"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,20.02,0)"><path d="M535 323V373H52V323H535ZM535 138V188H52V138H535Z" id="g117-34"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="587" vert-adv-y="587" xpluscharwidth="27.651"></glyph.data></g><g transform="matrix(.013,0,0,-0.013,31.283,0)"><path d="M384 0V27C293 34 287 42 287 114V635C232 613 172 594 109 583V559L157 557C201 555 205 550 205 499V114C205 42 199 34 109 27V0H384Z" id="g113-50"></path><glyph.data ascent="3473" descent="-2876" horiz-adv-x="480" vert-adv-y="480" xpluscharwidth="37.523"></glyph.data></g></svg></td></tr></table>

<div>Subnetwork for action taking by different agents.</div>

Discrete Dynamics in Nature and Society

fig3

Figure 3

Figure 3: A Decentralized Partially Observable Markov Decision Model with Action Duration for Goal Recognition in Real Time Strategy Games 