An In-depth Benchmarking of Evolutionary and Swarm Intelligence Algorithms for Autoscaling Parameter Sweep Applications on Public Clouds

Table 11

Average running time (seconds) of each variant of the autoscaler MOEA.

Application	Size	MOEA-NSGA-III	MOEA-E-NSGA-III	MOEA-SMPSO	MOEA-SMS-EMOA
MPG	30	4	6	7	670
	100	20	31	54	1767
	300	110	156	258	3270
GMS	30	7	10	13	890
	100	37	40	88	1571
	300	210	299	352	4271
FPA	30	4	4	5	430
	100	24	27	33	1221
	300	80	101	244	2683
WRF	30	4	6	11	889
	100	30	43	67	2277
	300	129	291	337	3613

The significance level of bold values given in Table 11 is α = 0.001 (significance level).