Research Article
Margin-Based Pareto Ensemble Pruning: An Ensemble Pruning Algorithm That Learns to Search Optimized Ensembles
Table 4
Test errors in the noisy classification problem.
| Noise | Data sets | Ours (%) | Full bagging (%) | RE pruning (%) | Kappa pruning (%) | CM pruning (%) | MDM pruning (%) | EA pruning (%) |
| 0.00 | Diabetes | 22.10 | 25.10 | 24.30 | 24.30 | 24.30 | 24.20 | 24.00 | German | 22.50 | 25.30 | 24.10 | 24.10 | 23.90 | 24.00 | 24.30 | Heart-statlog | 23.50 | 19.50 | 18.70 | 20.10 | 19.90 | 19.90 | 19.60 | Ionosphere | 5.70 | 9.20 | 8.60 | 8.40 | 8.90 | 10.00 | 9.30 | Sonar | 21.40 | 26.60 | 26.70 | 24.90 | 25.00 | 26.80 | 25.10 | Vehicle | 21.90 | 22.80 | 22.60 | 23.30 | 23.40 | 24.40 | 23.00 | Waveform | 20.80 | 22.20 | 20.50 | 20.90 | 20.30 | 20.10 | 20.50 |
| 0.02 | Diabetes | 24.20 | 26.60 | 26.60 | 26.30 | 26.70 | 26.40 | 27.00 | German | 24.40 | 27.70 | 27.70 | 28.10 | 27.00 | 27.10 | 27.60 | Heart-statlog | 24.30 | 23.20 | 22.70 | 21.60 | 22.00 | 22.20 | 23.10 | Ionosphere | 7.20 | 13.10 | 11.80 | 13.00 | 11.50 | 11.30 | 12.20 | Sonar | 23.40 | 28.10 | 24.00 | 26.20 | 24.60 | 23.50 | 25.30 | Vehicle | 25.80 | 33.00 | 29.90 | 29.90 | 29.60 | 30.10 | 29.80 | Waveform | 25.20 | 26.80 | 24.30 | 25.80 | 24.20 | 23.90 | 24.50 |
| 0.04 | Diabetes | 27.30 | 30.10 | 29.60 | 29.70 | 29.60 | 29.40 | 30.10 | German | 29.10 | 31.00 | 30.10 | 31.30 | 29.90 | 29.70 | 30.70 | Heart-statlog | 28.00 | 28.20 | 28.10 | 26.50 | 27.50 | 27.50 | 28.00 | Ionosphere | 11.40 | 17.70 | 15.80 | 18.30 | 15.70 | 15.90 | 17.50 | Sonar | 25.10 | 30.10 | 28.10 | 29.60 | 27.70 | 25.90 | 28.30 | Vehicle | 25.10 | 30.10 | 28.10 | 29.60 | 27.70 | 25.90 | 28.30 | Waveform | 27.50 | 30.10 | 28.10 | 29.20 | 27.90 | 27.60 | 28.60 |
| 0.08 | Diabetes | 27.50 | 30.10 | 28.10 | 29.20 | 27.90 | 27.60 | 28.60 | German | 33.60 | 36.20 | 36.10 | 36.40 | 35.90 | 36.10 | 38.20 | Heart-statlog | 32.40 | 33.40 | 32.60 | 32.90 | 33.20 | 33.30 | 34.40 | Ionosphere | 26.40 | 27.50 | 26.50 | 27.60 | 26.60 | 26.50 | 27.90 | Sonar | 32.30 | 36.10 | 36.50 | 38.40 | 35.70 | 36.40 | 36.50 | Vehicle | 38.70 | 43.00 | 40.60 | 42.00 | 40.50 | 40.20 | 41.60 | Waveform | 34.30 | 37.60 | 35.80 | 36.80 | 35.60 | 35.30 | 37.40 |
|
|