Research Article
Empirical Study of Homogeneous and Heterogeneous Ensemble Models for Software Development Effort Estimation
Table 8
Models’ performance using COCOMO dataset.
| | Model type | Model | MMRE | PRED(25) | EF |
| | Individual | MLP | 250.77 | 23.1 | 0.09 | | SVR | 803.96 | 7.7 | 0.01 | | ANFIS | 532.33 | 23.1 | 0.04 |
| Homogeneous ensemble
(MLP) | HM-MLP-[Avg] | 68.53 | 23.1 | 0.33 | | HM-MLP-[WtAvg] | 68.62 | 23.1 | 0.33 | | HM-MLP-[MLP] | 71.57 | 23.1 | 0.32 | | HM-MLP-[SVR] | 466.60 | 0.0 | 0.00 | | HM-MLP-[FIS-FCM] | 432.81 | 23.1 | 0.05 | | HM-MLP-[FIS-SC] | 102.49 | 0.0 | 0.00 | | HM-MLP-[ANFIS-FCM] | 98.98 | 15.4 | 0.15 | | HM-MLP-[ANFIS-SC] | 307.08 | 15.4 | 0.05 |
| Homogeneous ensemble
(SVR) | HM-SVR-[Avg] | 131.79 | 7.7 | 0.06 | | HM-SVR-[WtAvg] | 131.34 | 7.7 | 0.06 | | HM-SVR-[MLP] | 71.57 | 23.1 | 0.32 | | HM-SVR-[SVR] | 515.51 | 0.0 | 0.00 | | HM-SVR-[FIS-FCM] | 1471.43 | 0.0 | 0.00 | | HM-SVR-[FIS-SC] | 102.49 | 0.0 | 0.00 | | HM-SVR-[ANFIS-FCM] | 305.68 | 23.1 | 0.08 | | HM-SVR-[ANFIS-SC] | 131.46 | 23.1 | 0.17 |
| Homogeneous ensemble
(ANFIS) | HM-ANFIS-[Avg] | 165.57 | 15.4 | 0.09 | | HM-ANFIS-[WtAvg] | 165.57 | 15.4 | 0.09 | | HM-ANFIS-[MLP] | 1059.11 | 7.7 | 0.01 | | HM-ANFIS-[SVR] | 480.86 | 7.7 | 0.02 | | HM-ANFIS-[FIS-FCM] | 2804.98 | 0.0 | 0.00 | | HM-ANFIS-[FIS-SC] | 147249731.42 | 0.0 | 0.00 | | HM-ANFIS-[ANFIS-FCM] | 587.09 | 15.4 | 0.03 | | HM-ANFIS-[ANFIS-SC] | 177.90 | 30.8 | 0.17 |
| Heterogeneous ensemble
(MLP, SVR, ANFIS) | HT-(MLP, SVR, ANFIS)-[Avg] | 109.79 | 7.7 | 0.07 | | HT-(MLP, SVR, ANFIS)-[WtAvg] | 83.81 | 15.4 | 0.18 | | HT-(MLP, SVR, ANFIS)-[MLP] | 881.83 | 0.0 | 0.00 | | HT-(MLP, SVR, ANFIS)-[SVR] | 479.36 | 7.7 | 0.02 | | HT-(MLP, SVR, ANFIS)-[FIS-FCM] | 2359.23 | 0.0 | 0.00 | | HT-(MLP, SVR, ANFIS)-[FIS-SC] | 478644.93 | 7.7 | 0.00 | | HT-(MLP, SVR, ANFIS)-[ANFIS-FCM] | 468.18 | 30.8 | 0.07 | | HT-(MLP, SVR, ANFIS)-[ANFIS-SC] | 135.16 | 30.8 | 0.23 |
|
|
