Empirical Study of Homogeneous and Heterogeneous Ensemble Models for Software Development Effort Estimation

Table 5

Models’ performance using Albrecht dataset.

Model type	Model	MMRE	PRED(25)	EF
Individual	MLP	64.60	40.0	0.61
	SVR	81.40	20.0	0.24
	ANFIS	78.61	20.0	0.25
Homogeneous ensemble; (MLP)	HM-MLP-[Avg]	32.99	20.0	0.59
	HM-MLP-[WtAvg]	44.13	40.0	0.89
	HM-MLP-[MLP]	54.23	40.0	0.72
	HM-MLP-[SVR]	74.38	40.0	0.53
	HM-MLP-[FIS-FCM]	61.43	20.0	0.32
	HM-MLP-[FIS-SC]	43.87	40.0	0.89
	HM-MLP-[ANFIS-FCM]	72.52	40.0	0.54
	HM-MLP-[ANFIS-SC]	63.04	20.0	0.31
Homogeneous ensemble; (SVR)	HM-SVR-[Avg]	67.65	20.0	0.29
	HM-SVR-[WtAvg]	68.02	20.0	0.29
	HM-SVR-[MLP]	69.30	20.0	0.28
	HM-SVR-[SVR]	74.25	40.0	0.53
	HM-SVR-[FIS-FCM]	77.52	20.0	0.25
	HM-SVR-[FIS-SC]	94.58	0.0	0.00
	HM-SVR-[ANFIS-FCM]	48.63	60.0	1.21
	HM-SVR-[ANFIS-SC]	38.20	60.0	1.53
Homogeneous ensemble; (ANFIS)	HM-ANFIS-[Avg]	75.88	0.0	0.00
	HM-ANFIS-[WtAvg]	69.43	20.0	0.28
	HM-ANFIS-[MLP]	68.16	40.0	0.58
	HM-ANFIS-[SVR]	80.83	40.0	0.49
	HM-ANFIS-[FIS-FCM]	67.24	20.0	0.29
	HM-ANFIS-[FIS-SC]	108.83	0.0	0.00
	HM-ANFIS-[ANFIS-FCM]	67.30	20.0	0.29
	HM-ANFIS-[ANFIS-SC]	136.01	0.0	0.00
Heterogeneous ensemble; (MLP, SVR, ANFIS)	HT-(MLP, SVR, ANFIS)-[Avg]	84.79	0.0	0.00
	HT-(MLP, SVR, ANFIS)-[WtAvg]	73.30	20.0	0.27
	HT-(MLP, SVR, ANFIS)-[MLP]	92.03	20.0	0.21
	HT-(MLP, SVR, ANFIS)-[SVR]	87.70	20.0	0.23
	HT-(MLP, SVR, ANFIS)-[FIS-FCM]	106.82	0.0	0.00
	HT-(MLP, SVR, ANFIS)-[FIS-SC]	86.77	0.0	0.00
	HT-(MLP, SVR, ANFIS)-[ANFIS-FCM]	60.59	20.0	0.32
	HT-(MLP, SVR, ANFIS)-[ANFIS-SC]	58.82	20.0	0.33