Research Article
Empirical Study of Homogeneous and Heterogeneous Ensemble Models for Software Development Effort Estimation
Table 9
Models’ performance using Desharnais dataset.
| Model type | Model | MMRE | PRED (25) | EF |
| Individual | MLP | 78.24 | 20.0 | 0.25 | SVR | 73.83 | 33.3 | 0.45 | ANFIS | 105.70 | 20.0 | 0.19 |
| Homogeneous ensemble (MLP) | HM-MLP-[Avg] | 68.68 | 26.7 | 0.38 | HM-MLP-[WtAvg] | 69.34 | 26.7 | 0.38 | HM-MLP-[MLP] | 81.79 | 20.0 | 0.24 | HM-MLP-[SVR] | 90.79 | 26.7 | 0.29 | HM-MLP-[FIS-FCM] | 78.94 | 26.7 | 0.33 | HM-MLP-[FIS-SC] | 62.21 | 26.7 | 0.42 | HM-MLP-[ANFIS-FCM] | 62.84 | 26.7 | 0.42 | HM-MLP-[ANFIS-SC] | 62.05 | 26.7 | 0.42 |
| Homogeneous ensemble (SVR) | HM-SVR-[Avg] | 59.01 | 40.0 | 0.67 | HM-SVR-[WtAvg] | 59.03 | 40.0 | 0.67 | HM-SVR-[MLP] | 83.97 | 20.0 | 0.24 | HM-SVR-[SVR] | 93.03 | 26.7 | 0.28 | HM-SVR-[FIS-FCM] | 97.45 | 13.3 | 0.14 | HM-SVR-[FIS-SC] | 82.08 | 20.0 | 0.24 | HM-SVR-[ANFIS-FCM] | 81.97 | 20.0 | 0.24 | HM-SVR-[ANFIS-SC] | 76.57 | 26.7 | 0.34 |
| Homogeneous ensemble (ANFIS) | HM-ANFIS-[Avg] | 115.32 | 20.0 | 0.17 | HM-ANFIS-[WtAvg] | 105.88 | 20.0 | 0.19 | HM-ANFIS-[MLP] | 107.53 | 26.7 | 0.25 | HM-ANFIS-[SVR] | 90.80 | 26.7 | 0.29 | HM-ANFIS-[FIS-FCM] | 104.29 | 13.3 | 0.13 | HM-ANFIS-[FIS-SC] | 92.21 | 6.7 | 0.07 | HM-ANFIS-[ANFIS-FCM] | 4850.60 | 13.3 | 0.00 | HM-ANFIS-[ANFIS-SC] | 91.54 | 13.3 | 0.14 |
| Heterogeneous ensemble (MLP, SVR, ANFIS) | HT-(MLP, SVR, ANFIS)-[Avg] | 66.13 | 33.3 | 0.50 | HT-(MLP, SVR, ANFIS)-[WtAvg] | 66.86 | 26.7 | 0.39 | HT-(MLP, SVR, ANFIS)-[MLP] | 79.30 | 33.3 | 0.42 | HT-(MLP, SVR, ANFIS)-[SVR] | 92.49 | 26.7 | 0.29 | HT-(MLP, SVR, ANFIS)-[FIS-FCM] | 85.29 | 20.0 | 0.23 | HT-(MLP, SVR, ANFIS)-[FIS-SC] | 63.60 | 20.0 | 0.31 | HT-(MLP, SVR, ANFIS)-[ANFIS-FCM] | 76.14 | 40.0 | 0.52 | HT-(MLP, SVR, ANFIS)-[ANFIS-SC] | 68.20 | 20.0 | 0.29 |
|
|