Research Article
A Novel Approach to Ensemble Classifiers: FsBoost-Based Subspace Method
Table 12
Comparing the FsBoost algorithm with single classifiers and boosting algorithms for other datasets.
| Method | Datasets | Mean | Basehock | Madelon | PCMAC | Rank | Acc | Rank | Acc | Rank | Acc | Acc | Rank |
| AdaBoostM1 | 5 | 59.34 | 17 | 52.92 | 2 | 63.75 | 58.67 | 5 | Bag | 17 | 50.90 | 8 | 55.00 | 17 | 52.73 | 52.88 | 17 | GentleBoost | 13 | 58.23 | 15 | 53.54 | 5 | 62.82 | 58.20 | 9 | LogitBoost | 12 | 58.43 | 14 | 53.69 | 3 | 63.54 | 58.56 | 6 | LPBoost | 16 | 56.22 | 7 | 55.15 | 16 | 52.83 | 54.74 | 16 | RobustBoost | 4 | 59.54 | 13 | 53.77 | 1 | 63.95 | 59.09 | 2 | RUSBoost | 15 | 56.33 | 6 | 56.00 | 12 | 56.02 | 56.12 | 14 | Subspace | 11 | 58.55 | 16 | 53.31 | 15 | 54.04 | 55.30 | 15 | TotalBoost | 6 | 59.04 | 12 | 54.38 | 4 | 62.82 | 58.75 | 4 |
| FsBoost.V1 | Level 1 kNN ensemble | 10 | 58.73 | 3 | 56.85 | 14 | 54.27 | 56.62 | 12 | Level 1 PNN ensemble | 2 | 59.74 | 2 | 56.92 | 11 | 58.81 | 58.49 | 8 | Level 1 SVM ensemble | 7 | 58.84 | 11 | 54.54 | 10 | 60.14 | 57.84 | 11 | Level 2 ensemble | 1 | 60.14 | 4 | 56.62 | 9 | 60.56 | 59.10 | 1 |
| FsBoost.V2 | Level 1—ensemble 1 | 9 | 58.84 | 10 | 54.62 | 6 | 62.20 | 58.55 | 7 | Level 1—ensemble 2 | 8 | 58.84 | 9 | 54.69 | 7 | 60.87 | 58.13 | 10 | Level 1—ensemble 3 | 14 | 57.33 | 1 | 57.38 | 13 | 54.89 | 56.54 | 13 | Level 2 ensemble | 3 | 59.74 | 5 | 56.54 | 8 | 60.76 | 59.01 | 3 | kNN | | 59.04 | | 54.23 | | 54.58 | | | PNN | | 57.23 | | 53.00 | | 58.39 | | | SVMs | | 56.22 | | 54.69 | | 61.89 | | |
|
|
Acc: accuracy (%).
|