A Reinforcement Learning Based Auto-Scaling Approach for SaaS Providers in Dynamic Cloud Environment

<div>Everyday reward of <svg height="11.6836pt" id="M229" style="vertical-align:-3.29562pt" version="1.1" viewbox="-0.0498162 -8.38798 23.7814 11.6836" width="23.7814pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M631 18C609 24 585 35 559 65C534 91 514 117 478 169C448 214 406 281 389 313C462 346 516 399 516 485C516 545 490 590 449 616C412 641 363 650 290 650H42V622C120 615 128 612 128 527V125C128 40 120 34 38 28V0H300V28C221 34 212 40 212 125V284H244C295 284 312 272 329 244C359 195 395 133 430 84C475 19 516 -3 592 -7C603 -8 615 -8 627 -8L631 18ZM212 316V563C212 591 215 602 223 607C231 613 248 617 277 617C352 617 423 577 423 469C423 415 407 375 368 345C343 324 310 316 260 316H212Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,8.073,3.132)"><path d="M327 325C324 350 312 408 304 433C283 442 256 451 213 451C120 451 59 391 59 320C59 243 125 210 188 181C237 158 266 136 266 93C266 52 231 24 195 24C134 24 93 81 74 148L42 143C42 106 51 37 59 23C78 8 125 -12 177 -12C257 -12 345 35 345 127C345 198 292 234 216 264C171 283 131 305 131 348C131 387 156 416 195 416C243 416 277 378 297 317L327 325Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,11.531,3.132)"><path d="M442 39L431 68C420 63 406 57 394 57C377 57 359 71 359 118V301C359 353 349 393 314 424C291 443 261 451 230 451C171 438 107 401 79 381C59 366 46 355 46 340C46 316 72 295 91 295C106 295 117 303 122 319C131 350 139 371 152 384C163 397 178 404 197 404C246 404 281 365 281 293V278C260 262 186 232 124 213C69 194 41 161 41 112C41 47 92 -12 163 -12C195 -12 243 25 283 51C288 35 293 22 308 7C319 -4 339 -12 354 -12L442 39ZM281 87C262 68 226 51 199 51C169 51 129 74 129 126C129 162 151 181 190 198C211 208 259 229 281 240V87Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,15.617,3.132)"><path d="M442 39L431 68C420 63 406 57 394 57C377 57 359 71 359 118V301C359 353 349 393 314 424C291 443 261 451 230 451C171 438 107 401 79 381C59 366 46 355 46 340C46 316 72 295 91 295C106 295 117 303 122 319C131 350 139 371 152 384C163 397 178 404 197 404C246 404 281 365 281 293V278C260 262 186 232 124 213C69 194 41 161 41 112C41 47 92 -12 163 -12C195 -12 243 25 283 51C288 35 293 22 308 7C319 -4 339 -12 354 -12L442 39ZM281 87C262 68 226 51 199 51C169 51 129 74 129 126C129 162 151 181 190 198C211 208 259 229 281 240V87Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,19.676,3.132)"><path d="M327 325C324 350 312 408 304 433C283 442 256 451 213 451C120 451 59 391 59 320C59 243 125 210 188 181C237 158 266 136 266 93C266 52 231 24 195 24C134 24 93 81 74 148L42 143C42 106 51 37 59 23C78 8 125 -12 177 -12C257 -12 345 35 345 127C345 198 292 234 216 264C171 283 131 305 131 348C131 387 156 416 195 416C243 416 277 378 297 317L327 325Z"></path></g></svg> in on-demand market.</div>

Mathematical Problems in Engineering

fig3

Figure 3

Figure 3: A Reinforcement Learning Based Auto-Scaling Approach for SaaS Providers in Dynamic Cloud Environment 