A Reinforcement Learning Based Auto-Scaling Approach for SaaS Providers in Dynamic Cloud Environment

<table class="figure-group"><tr class="fig-image" id="a"><td><object data="https://static.hindawi.com/articles/mpe/volume-2019/5080647/figures/5080647.fig.007a.svgz" name="5080647.fig.007a" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(a) </b>Reward with different <svg height="12.0621pt" id="M252" style="vertical-align:-3.2957pt" version="1.1" viewbox="-0.0498162 -8.7664 50.6838 12.0621" width="50.6838pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M592 498C586 556 582 629 581 675H560C545 656 537 650 510 650H115C87 650 74 652 60 675H40C38 620 33 555 28 495H57C69 539 77 568 89 585C102 607 122 616 205 616H267V123C267 44 259 34 168 28V0H454V28C360 34 352 44 352 123V616H422C498 616 514 608 531 584C542 568 552 543 562 495L592 498Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,8.021,3.132)"><path d="M185 344V453C137 433 92 421 41 413V386C100 378 104 375 104 310V106C104 41 97 35 33 30V0H268V30C190 35 185 41 185 107V283C206 340 240 371 267 371C282 371 296 364 310 351C316 344 325 343 336 348C357 357 369 378 369 399C369 424 345 451 310 451C262 451 219 397 187 344H185Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,11.369,3.132)"><path d="M384 109C349 76 310 59 268 59C197 59 123 113 120 245C240 248 367 259 384 262C403 266 407 275 407 296C407 376 338 451 254 451H253C201 451 148 425 105 378C65 334 39 272 39 203C39 88 112 -12 235 -12C266 -12 339 5 402 84L384 109ZM230 411C285 411 319 365 319 313C319 298 313 293 294 293C236 291 180 290 125 290C141 370 185 411 230 411Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,15.291,3.132)"><path d="M327 325C324 350 312 408 304 433C283 442 256 451 213 451C120 451 59 391 59 320C59 243 125 210 188 181C237 158 266 136 266 93C266 52 231 24 195 24C134 24 93 81 74 148L42 143C42 106 51 37 59 23C78 8 125 -12 177 -12C257 -12 345 35 345 127C345 198 292 234 216 264C171 283 131 305 131 348C131 387 156 416 195 416C243 416 277 378 297 317L327 325Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,18.786,3.132)"><path d="M384 109C349 76 310 59 268 59C197 59 123 113 120 245C240 248 367 259 384 262C403 266 407 275 407 296C407 376 338 451 254 451H253C201 451 148 425 105 378C65 334 39 272 39 203C39 88 112 -12 235 -12C266 -12 339 5 402 84L384 109ZM230 411C285 411 319 365 319 313C319 298 313 293 294 293C236 291 180 290 125 290C141 370 185 411 230 411Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,22.735,3.132)"><path d="M185 344V453C137 433 92 421 41 413V386C100 378 104 375 104 310V106C104 41 97 35 33 30V0H268V30C190 35 185 41 185 107V283C206 340 240 371 267 371C282 371 296 364 310 351C316 344 325 343 336 348C357 357 369 378 369 399C369 424 345 451 310 451C262 451 219 397 187 344H185Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,26.467,3.132)"><path d="M487 439H304V409C361 402 367 391 351 344C328 280 297 190 262 110C235 178 192 284 168 353C152 396 153 403 208 409V439H-1V409C54 401 61 394 85 338C133 221 179 111 224 -10H255C312 139 363 260 398 336C426 394 432 401 487 409V439Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,30.9,3.132)"><path d="M442 39L431 68C420 63 406 57 394 57C377 57 359 71 359 118V301C359 353 349 393 314 424C291 443 261 451 230 451C171 438 107 401 79 381C59 366 46 355 46 340C46 316 72 295 91 295C106 295 117 303 122 319C131 350 139 371 152 384C163 397 178 404 197 404C246 404 281 365 281 293V278C260 262 186 232 124 213C69 194 41 161 41 112C41 47 92 -12 163 -12C195 -12 243 25 283 51C288 35 293 22 308 7C319 -4 339 -12 354 -12L442 39ZM281 87C262 68 226 51 199 51C169 51 129 74 129 126C129 162 151 181 190 198C211 208 259 229 281 240V87Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,34.821,3.132)"><path d="M303 37L293 66C280 59 256 49 231 49S173 63 173 143V396H281C294 404 298 428 287 439H173V575L158 577L92 509V439H46L17 408L22 396H92V107C92 27 128 -12 192 -12C203 -12 218 -9 237 2L303 37Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,37.715,3.132)"><path d="M138 535C169 535 191 560 191 589C191 620 168 644 139 644S85 620 85 589C85 560 110 535 138 535ZM257 0V30C192 35 185 43 185 109V453C142 435 94 422 40 414V386C101 378 104 372 104 311V109C104 41 97 35 33 30V0H257Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,40.218,3.132)"><path d="M262 451C169 451 38 375 38 210C38 98 121 -12 261 -12C360 -12 481 64 481 227C481 351 386 451 262 451ZM249 414C337 414 385 320 385 204C385 70 333 25 272 25C189 25 134 117 134 241C134 355 189 414 249 414Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,44.831,3.132)"><path d="M532 0V30C473 38 467 38 467 107V298C467 395 416 451 336 451C307 451 279 439 251 420C226 404 205 389 185 374V453C142 434 94 422 43 413V386C98 378 104 373 104 309V107C104 41 100 38 31 30V0H251V30C191 35 185 40 185 107V337C216 364 255 389 295 389C360 389 386 347 386 276V110C386 44 380 35 321 30V0H532Z"></path></g></svg></td></tr><tr class="fig-image" id="b"><td><object data="https://static.hindawi.com/articles/mpe/volume-2019/5080647/figures/5080647.fig.007b.svgz" name="5080647.fig.007b" type="image/svg+xml"></object></td></tr><tr class="fig-caption"><td><b>(b) </b>Workload with different <svg height="12.0621pt" id="M253" style="vertical-align:-3.2957pt" version="1.1" viewbox="-0.0498162 -8.7664 50.6838 12.0621" width="50.6838pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M592 498C586 556 582 629 581 675H560C545 656 537 650 510 650H115C87 650 74 652 60 675H40C38 620 33 555 28 495H57C69 539 77 568 89 585C102 607 122 616 205 616H267V123C267 44 259 34 168 28V0H454V28C360 34 352 44 352 123V616H422C498 616 514 608 531 584C542 568 552 543 562 495L592 498Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,8.021,3.132)"><path d="M185 344V453C137 433 92 421 41 413V386C100 378 104 375 104 310V106C104 41 97 35 33 30V0H268V30C190 35 185 41 185 107V283C206 340 240 371 267 371C282 371 296 364 310 351C316 344 325 343 336 348C357 357 369 378 369 399C369 424 345 451 310 451C262 451 219 397 187 344H185Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,11.369,3.132)"><path d="M384 109C349 76 310 59 268 59C197 59 123 113 120 245C240 248 367 259 384 262C403 266 407 275 407 296C407 376 338 451 254 451H253C201 451 148 425 105 378C65 334 39 272 39 203C39 88 112 -12 235 -12C266 -12 339 5 402 84L384 109ZM230 411C285 411 319 365 319 313C319 298 313 293 294 293C236 291 180 290 125 290C141 370 185 411 230 411Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,15.291,3.132)"><path d="M327 325C324 350 312 408 304 433C283 442 256 451 213 451C120 451 59 391 59 320C59 243 125 210 188 181C237 158 266 136 266 93C266 52 231 24 195 24C134 24 93 81 74 148L42 143C42 106 51 37 59 23C78 8 125 -12 177 -12C257 -12 345 35 345 127C345 198 292 234 216 264C171 283 131 305 131 348C131 387 156 416 195 416C243 416 277 378 297 317L327 325Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,18.786,3.132)"><path d="M384 109C349 76 310 59 268 59C197 59 123 113 120 245C240 248 367 259 384 262C403 266 407 275 407 296C407 376 338 451 254 451H253C201 451 148 425 105 378C65 334 39 272 39 203C39 88 112 -12 235 -12C266 -12 339 5 402 84L384 109ZM230 411C285 411 319 365 319 313C319 298 313 293 294 293C236 291 180 290 125 290C141 370 185 411 230 411Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,22.735,3.132)"><path d="M185 344V453C137 433 92 421 41 413V386C100 378 104 375 104 310V106C104 41 97 35 33 30V0H268V30C190 35 185 41 185 107V283C206 340 240 371 267 371C282 371 296 364 310 351C316 344 325 343 336 348C357 357 369 378 369 399C369 424 345 451 310 451C262 451 219 397 187 344H185Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,26.467,3.132)"><path d="M487 439H304V409C361 402 367 391 351 344C328 280 297 190 262 110C235 178 192 284 168 353C152 396 153 403 208 409V439H-1V409C54 401 61 394 85 338C133 221 179 111 224 -10H255C312 139 363 260 398 336C426 394 432 401 487 409V439Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,30.9,3.132)"><path d="M442 39L431 68C420 63 406 57 394 57C377 57 359 71 359 118V301C359 353 349 393 314 424C291 443 261 451 230 451C171 438 107 401 79 381C59 366 46 355 46 340C46 316 72 295 91 295C106 295 117 303 122 319C131 350 139 371 152 384C163 397 178 404 197 404C246 404 281 365 281 293V278C260 262 186 232 124 213C69 194 41 161 41 112C41 47 92 -12 163 -12C195 -12 243 25 283 51C288 35 293 22 308 7C319 -4 339 -12 354 -12L442 39ZM281 87C262 68 226 51 199 51C169 51 129 74 129 126C129 162 151 181 190 198C211 208 259 229 281 240V87Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,34.821,3.132)"><path d="M303 37L293 66C280 59 256 49 231 49S173 63 173 143V396H281C294 404 298 428 287 439H173V575L158 577L92 509V439H46L17 408L22 396H92V107C92 27 128 -12 192 -12C203 -12 218 -9 237 2L303 37Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,37.715,3.132)"><path d="M138 535C169 535 191 560 191 589C191 620 168 644 139 644S85 620 85 589C85 560 110 535 138 535ZM257 0V30C192 35 185 43 185 109V453C142 435 94 422 40 414V386C101 378 104 372 104 311V109C104 41 97 35 33 30V0H257Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,40.218,3.132)"><path d="M262 451C169 451 38 375 38 210C38 98 121 -12 261 -12C360 -12 481 64 481 227C481 351 386 451 262 451ZM249 414C337 414 385 320 385 204C385 70 333 25 272 25C189 25 134 117 134 241C134 355 189 414 249 414Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,44.831,3.132)"><path d="M532 0V30C473 38 467 38 467 107V298C467 395 416 451 336 451C307 451 279 439 251 420C226 404 205 389 185 374V453C142 434 94 422 43 413V386C98 378 104 373 104 309V107C104 41 100 38 31 30V0H251V30C191 35 185 40 185 107V337C216 364 255 389 295 389C360 389 386 347 386 276V110C386 44 380 35 321 30V0H532Z"></path></g></svg></td></tr></table>

<div>Comparison results regarding different <span class="nowrap"><svg height="12.0621pt" id="M251" style="vertical-align:-3.2957pt" version="1.1" viewbox="-0.0498162 -8.7664 50.6838 12.0621" width="50.6838pt" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"><g transform="matrix(.013,0,0,-0.013,0,0)"><path d="M592 498C586 556 582 629 581 675H560C545 656 537 650 510 650H115C87 650 74 652 60 675H40C38 620 33 555 28 495H57C69 539 77 568 89 585C102 607 122 616 205 616H267V123C267 44 259 34 168 28V0H454V28C360 34 352 44 352 123V616H422C498 616 514 608 531 584C542 568 552 543 562 495L592 498Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,8.021,3.132)"><path d="M185 344V453C137 433 92 421 41 413V386C100 378 104 375 104 310V106C104 41 97 35 33 30V0H268V30C190 35 185 41 185 107V283C206 340 240 371 267 371C282 371 296 364 310 351C316 344 325 343 336 348C357 357 369 378 369 399C369 424 345 451 310 451C262 451 219 397 187 344H185Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,11.369,3.132)"><path d="M384 109C349 76 310 59 268 59C197 59 123 113 120 245C240 248 367 259 384 262C403 266 407 275 407 296C407 376 338 451 254 451H253C201 451 148 425 105 378C65 334 39 272 39 203C39 88 112 -12 235 -12C266 -12 339 5 402 84L384 109ZM230 411C285 411 319 365 319 313C319 298 313 293 294 293C236 291 180 290 125 290C141 370 185 411 230 411Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,15.291,3.132)"><path d="M327 325C324 350 312 408 304 433C283 442 256 451 213 451C120 451 59 391 59 320C59 243 125 210 188 181C237 158 266 136 266 93C266 52 231 24 195 24C134 24 93 81 74 148L42 143C42 106 51 37 59 23C78 8 125 -12 177 -12C257 -12 345 35 345 127C345 198 292 234 216 264C171 283 131 305 131 348C131 387 156 416 195 416C243 416 277 378 297 317L327 325Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,18.786,3.132)"><path d="M384 109C349 76 310 59 268 59C197 59 123 113 120 245C240 248 367 259 384 262C403 266 407 275 407 296C407 376 338 451 254 451H253C201 451 148 425 105 378C65 334 39 272 39 203C39 88 112 -12 235 -12C266 -12 339 5 402 84L384 109ZM230 411C285 411 319 365 319 313C319 298 313 293 294 293C236 291 180 290 125 290C141 370 185 411 230 411Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,22.735,3.132)"><path d="M185 344V453C137 433 92 421 41 413V386C100 378 104 375 104 310V106C104 41 97 35 33 30V0H268V30C190 35 185 41 185 107V283C206 340 240 371 267 371C282 371 296 364 310 351C316 344 325 343 336 348C357 357 369 378 369 399C369 424 345 451 310 451C262 451 219 397 187 344H185Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,26.467,3.132)"><path d="M487 439H304V409C361 402 367 391 351 344C328 280 297 190 262 110C235 178 192 284 168 353C152 396 153 403 208 409V439H-1V409C54 401 61 394 85 338C133 221 179 111 224 -10H255C312 139 363 260 398 336C426 394 432 401 487 409V439Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,30.9,3.132)"><path d="M442 39L431 68C420 63 406 57 394 57C377 57 359 71 359 118V301C359 353 349 393 314 424C291 443 261 451 230 451C171 438 107 401 79 381C59 366 46 355 46 340C46 316 72 295 91 295C106 295 117 303 122 319C131 350 139 371 152 384C163 397 178 404 197 404C246 404 281 365 281 293V278C260 262 186 232 124 213C69 194 41 161 41 112C41 47 92 -12 163 -12C195 -12 243 25 283 51C288 35 293 22 308 7C319 -4 339 -12 354 -12L442 39ZM281 87C262 68 226 51 199 51C169 51 129 74 129 126C129 162 151 181 190 198C211 208 259 229 281 240V87Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,34.821,3.132)"><path d="M303 37L293 66C280 59 256 49 231 49S173 63 173 143V396H281C294 404 298 428 287 439H173V575L158 577L92 509V439H46L17 408L22 396H92V107C92 27 128 -12 192 -12C203 -12 218 -9 237 2L303 37Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,37.715,3.132)"><path d="M138 535C169 535 191 560 191 589C191 620 168 644 139 644S85 620 85 589C85 560 110 535 138 535ZM257 0V30C192 35 185 43 185 109V453C142 435 94 422 40 414V386C101 378 104 372 104 311V109C104 41 97 35 33 30V0H257Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,40.218,3.132)"><path d="M262 451C169 451 38 375 38 210C38 98 121 -12 261 -12C360 -12 481 64 481 227C481 351 386 451 262 451ZM249 414C337 414 385 320 385 204C385 70 333 25 272 25C189 25 134 117 134 241C134 355 189 414 249 414Z"></path></g><g transform="matrix(.0091,0,0,-0.0091,44.831,3.132)"><path d="M532 0V30C473 38 467 38 467 107V298C467 395 416 451 336 451C307 451 279 439 251 420C226 404 205 389 185 374V453C142 434 94 422 43 413V386C98 378 104 373 104 309V107C104 41 100 38 31 30V0H251V30C191 35 185 40 185 107V337C216 364 255 389 295 389C360 389 386 347 386 276V110C386 44 380 35 321 30V0H532Z"></path></g></svg>.</span></div>

Mathematical Problems in Engineering

fig7

Figure 7

Figure 7: A Reinforcement Learning Based Auto-Scaling Approach for SaaS Providers in Dynamic Cloud Environment 