Empirical Study of Homogeneous and Heterogeneous Ensemble Models for Software Development Effort Estimation

Table 10

Ranking of models based on EF metric (top 10 models are highlighted).

Model type	Model	Albrecht; dataset	Miyazaki; dataset	Maxwell; dataset	COCOMO; dataset	Desharnais; dataset
Individual	MLP	6	20	11	12	21
	SVR	26	24	13	24	5
	ANFIS	25	12	27	20	28
Homogeneous ensemble; (MLP)	HM-MLP-[Avg]	7	32	2	1	11
	HM-MLP-[WtAvg]	4	31	18	2	12
	HM-MLP-[MLP]	5	16	29	4	23
	HM-MLP-[SVR]	11	23	24	27	16
	HM-MLP-[FIS-FCM]	15	35	19	18	14
	HM-MLP-[FIS-SC]	3	13	8	27	7
	HM-MLP-[ANFIS-FCM]	9	8	31	9	8
	HM-MLP-[ANFIS-SC]	16	33	1	19	6
Homogeneous ensemble; (SVR)	HM-SVR-[Avg]	19	10	14	17	1
	HM-SVR-[WtAvg]	20	11	20	16	2
	HM-SVR-[MLP]	21	17	6	3	26
	HM-SVR-[SVR]	10	26	22	27	20
	HM-SVR-[FIS-FCM]	24	14	21	27	32
	HM-SVR-[FIS-SC]	29	2	15	27	25
	HM-SVR-[ANFIS-FCM]	2	22	34	13	24
	HM-SVR-[ANFIS-SC]	1	1	10	7	13
Homogeneous ensemble; (ANFIS)	HM-ANFIS-[Avg]	29	4	7	11	30
	HM-ANFIS-[WtAvg]	22	5	9	10	29
	HM-ANFIS-[MLP]	8	21	26	25	22
	HM-ANFIS-[SVR]	12	19	23	23	17
	HM-ANFIS-[FIS-FCM]	17	28	30	27	33
	HM-ANFIS-[FIS-SC]	29	30	12	27	34
	HM-ANFIS-[ANFIS-FCM]	18	9	33	21	35
	HM-ANFIS-[ANFIS-SC]	29	34	4	8	31
Heterogeneous ensemble; (MLP, SVR, ANFIS)	HT-(MLP, SVR, ANFIS)-[Avg]	29	6	16	14	4
	HT-(MLP, SVR, ANFIS)-[WtAvg]	23	3	17	6	10
	HT-(MLP, SVR, ANFIS)-[MLP]	28	7	28	27	9
	HT-(MLP, SVR, ANFIS)-[SVR]	27	25	25	22	19
	HT-(MLP, SVR, ANFIS)-[FIS-FCM]	29	27	34	27	27
	HT-(MLP, SVR, ANFIS)-[FIS-SC]	29	18	5	26	15
	HT-(MLP, SVR, ANFIS)-[ANFIS-FCM]	14	29	32	15	3
	HT-(MLP, SVR, ANFIS)-[ANFIS-SC]	13	15	3	5	18