Development of an AI-Enabled Q-Agent for Making Data Offloading Decisions in a Multi-RAT Wireless Network

<div>Remaining file size <svg height="11.5564pt" id="M214" style="vertical-align:-2.26807pt" version="1.1" viewbox="-0.0498162 -9.28833 15.8625 11.5564" width="15.8625pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M300 -147C201 -63 143 98 143 270S200 602 300 686L282 710C136 610 70 450 70 271V270C70 89 136 -72 282 -170L300 -147Z"></path></g><g transform="matrix(.013,0,0,-0.013,4.498,0)"><path d="M499 88L487 113C459 86 422 65 413 65C403 65 403 74 409 98L461 318C487 426 460 448 431 448C408 448 383 441 352 424C305 398 223 344 157 257H155L243 674C249 702 249 712 240 712C227 712 170 680 87 673L82 648H117C155 648 162 644 150 590L23 -4L30 -12C55 -4 81 3 105 8C113 53 131 150 143 187C199 281 323 387 372 387C390 387 393 369 380 311L328 86C313 19 319 -12 347 -12C379 -12 442 24 499 88Z"></path></g><g transform="matrix(.013,0,0,-0.013,11.206,0)"><path d="M275 270C275 450 212 609 64 710L45 686C145 604 203 442 203 270S147 -63 45 -147L64 -170C213 -68 275 89 275 270Z"></path></g></svg> at the end of each episode as a function <span class="nowrap"><svg height="9.25986pt" id="M215" style="vertical-align:-0.2455397pt" version="1.1" viewbox="-0.0498162 -9.01432 11.6478 9.25986" width="11.6478pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M810 587C770 574 761 568 725 543C654 630 540 687 408 687C217 687 69 577 69 430C69 319 160 247 276 247C369 247 511 319 511 495C511 510 512 523 509 538H490C490 354 393 277 274 277C174 277 110 344 110 422C110 559 219 655 415 655C524 655 636 602 695 519C628 463 572 392 516 303C433 170 377 97 313 57C252 89 199 109 143 109C79 109 36 87 36 54C36 15 82 -9 165 -9C222 -9 276 0 326 18C373 -1 423 -15 482 -15C645 -15 804 133 804 324C804 393 783 458 747 514C776 546 781 551 818 567L810 587ZM756 336C756 135 623 16 478 16C439 16 402 24 367 36C386 45 401 56 420 68C505 127 569 206 616 302C647 362 679 427 719 480C744 435 756 387 756 336ZM276 39C243 26 207 21 164 21C106 21 77 32 77 54C77 75 125 79 144 79C191 79 227 66 276 39Z"></path></g></svg>.</span></div>

Journal of Computer Networks and Communications

fig4

Figure 4

Figure 4: Development of an AI-Enabled Q-Agent for Making Data Offloading Decisions in a Multi-RAT Wireless Network 