Empirical Study of Homogeneous and Heterogeneous Ensemble Models for Software Development Effort Estimation

Table 7

Models’ performance using Maxwell dataset.

Model type	Model	MMRE	PRED(25)	EF
Individual	MLP	74.80	25.0	0.33
	SVR	101.31	33.3	0.33
	ANFIS	190.49	16.7	0.09
Homogeneous ensemble; (MLP)	HM-MLP-[Avg]	53.24	25.0	0.46
	HM-MLP-[WtAvg]	66.03	16.7	0.25
	HM-MLP-[MLP]	109.23	8.3	0.08
	HM-MLP-[SVR]	141.49	16.7	0.12
	HM-MLP-[FIS-FCM]	82.56	16.7	0.20
	HM-MLP-[FIS-SC]	64.36	25.0	0.38
	HM-MLP-[ANFIS-FCM]	2969.17	33.3	0.01
	HM-MLP-[ANFIS-SC]	60.53	33.3	0.54
Homogeneous ensemble; (SVR)	HM-SVR-[Avg]	77.74	25.0	0.32
	HM-SVR-[WtAvg]	100.87	16.7	0.16
	HM-SVR-[MLP]	85.26	33.3	0.39
	HM-SVR-[SVR]	139.33	16.7	0.12
	HM-SVR-[FIS-FCM]	106.43	16.7	0.16
	HM-SVR-[FIS-SC]	78.92	25.0	0.31
	HM-SVR-[ANFIS-FCM]	43183.76	0.0	0.00
	HM-SVR-[ANFIS-SC]	66.46	25.0	0.37
Homogeneous ensemble; (ANFIS)	HM-ANFIS-[Avg]	64.06	25.0	0.38
	HM-ANFIS-[WtAvg]	65.88	25.0	0.37
	HM-ANFIS-[MLP]	92.25	8.3	0.09
	HM-ANFIS-[SVR]	139.34	16.7	0.12
	HM-ANFIS-[FIS-FCM]	119.37	8.3	0.07
	HM-ANFIS-[FIS-SC]	75.25	25.0	0.33
	HM-ANFIS-[ANFIS-FCM]	419245.17	8.3	0.00
	HM-ANFIS-[ANFIS-SC]	59.89	25.0	0.41
Heterogeneous ensemble; (MLP, SVR, ANFIS)	HT-(MLP, SVR, ANFIS)-[Avg]	63.31	16.7	0.26
	HT-(MLP, SVR, ANFIS)-[WtAvg]	63.79	16.7	0.26
	HT-(MLP, SVR, ANFIS)-[MLP]	96.19	8.3	0.09
	HT-(MLP, SVR, ANFIS)-[SVR]	167.08	16.7	0.10
	HT-(MLP, SVR, ANFIS)-[FIS-FCM]	114.27	0.0	0.00
	HT-(MLP, SVR, ANFIS)-[FIS-SC]	62.34	25.0	0.39
	HT-(MLP, SVR, ANFIS)-[ANFIS-FCM]	312667.24	8.3	0.00
	HT-(MLP, SVR, ANFIS)-[ANFIS-SC]	59.49	25.0	0.41