Reinforcement Learning for Joint Channel/Subframe Selection of LTE in the Unlicensed Spectrum

<div>Action selection probability of AP5 for the original proposed scheme (<span class="nowrap"><svg height="9.01194pt" id="M130" style="vertical-align:-0.04981995pt" version="1.1" viewbox="-0.0498162 -8.96212 30.3161 9.01194" width="30.3161pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M669 636L663 650H260C230 650 221 652 208 675H186C177 621 162 548 144 481L173 479C195 534 211 560 226 578C248 604 266 615 373 615H544C460 511 114 112 23 16L31 0H561C577 34 611 135 622 170L594 182C566 125 544 88 515 65C481 38 416 35 319 35C249 35 197 37 152 41C270 184 542 501 669 636Z"></path></g><g transform="matrix(.013,0,0,-0.013,12.628,0)"><path d="M535 323V373H52V323H535ZM535 138V188H52V138H535Z"></path></g><g transform="matrix(.013,0,0,-0.013,23.891,0)"><path d="M384 0V27C293 34 287 42 287 114V635C232 613 172 594 109 583V559L157 557C201 555 205 550 205 499V114C205 42 199 34 109 27V0H384Z"></path></g></svg>,</span> <span class="nowrap"><svg height="9.49473pt" id="M131" style="vertical-align:-0.2063999pt" version="1.1" viewbox="-0.0498162 -9.28833 49.7978 9.49473" width="49.7978pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M494 514C482 587 419 712 303 712C238 712 174 667 174 603C174 561 205 514 249 449C219 438 187 422 162 407C93 366 23 283 23 177C23 69 87 -12 190 -12C244 -12 288 5 328 33C406 87 444 170 444 249C444 329 404 391 331 475C265 550 222 605 222 627C222 647 238 657 267 657C355 657 421 585 484 499L494 514ZM359 234C359 143 319 30 219 30C172 30 114 75 114 178C114 275 163 343 195 378C212 397 241 415 269 425C305 382 359 313 359 234Z"></path></g><g transform="matrix(.013,0,0,-0.013,10.354,0)"><path d="M535 323V373H52V323H535ZM535 138V188H52V138H535Z"></path></g><g transform="matrix(.013,0,0,-0.013,21.617,0)"><path d="M241 635C89 635 35 457 35 312C35 153 89 -12 240 -12C390 -12 443 166 443 312C443 466 390 635 241 635ZM238 602C329 602 354 454 354 312C354 172 330 22 240 22C152 22 124 173 124 313S148 602 238 602Z"></path></g><g transform="matrix(.013,0,0,-0.013,27.857,0)"><path d="M113 -12C146 -12 170 11 170 46C170 78 146 103 114 103S58 78 58 46C58 11 82 -12 113 -12Z"></path></g><g transform="matrix(.013,0,0,-0.013,30.821,0)"><path d="M241 635C89 635 35 457 35 312C35 153 89 -12 240 -12C390 -12 443 166 443 312C443 466 390 635 241 635ZM238 602C329 602 354 454 354 312C354 172 330 22 240 22C152 22 124 173 124 313S148 602 238 602Z"></path></g><g transform="matrix(.013,0,0,-0.013,37.061,0)"><path d="M241 635C89 635 35 457 35 312C35 153 89 -12 240 -12C390 -12 443 166 443 312C443 466 390 635 241 635ZM238 602C329 602 354 454 354 312C354 172 330 22 240 22C152 22 124 173 124 313S148 602 238 602Z"></path></g><g transform="matrix(.013,0,0,-0.013,43.301,0)"><path d="M384 0V27C293 34 287 42 287 114V635C232 613 172 594 109 583V559L157 557C201 555 205 550 205 499V114C205 42 199 34 109 27V0H384Z"></path></g></svg>).</span></div>

Wireless Communications and Mobile Computing

fig11

Figure 11

Figure 11: Reinforcement Learning for Joint Channel/Subframe Selection of LTE in the Unlicensed Spectrum 