Research Article
Margin-Based Pareto Ensemble Pruning: An Ensemble Pruning Algorithm That Learns to Search Optimized Ensembles
| Data sets | Ours | Full bagging | RE pruning | Kappa pruning | CM pruning | MDM pruning | EA pruning |
| Australian | 11.62% | 14.30% | 14.40% | 14.30% | 14.50% | 14.80% | 14.30% | Breast cancer | 23.83% | 27.90% | 27.70% | 28.70% | 29.20% | 29.50% | 27.50% | Liver | 25.73% | 32.70% | 32.00% | 32.60% | 30.60% | 33.70% | 31.70% | Heart-statlog | 23.50% | 19.50% | 18.70% | 20.10% | 19.90% | 19.90% | 19.60% | Waveform | 20.80% | 22.20% | 20.50% | 20.90% | 20.30% | 20.10% | 20.50% | Ionosphere | 5.70% | 9.20% | 8.60% | 8.40% | 8.90% | 10.00% | 9.30% | Kr-vs-kp | 0.90% | 1.50% | 1.00% | 1.00% | 1.10% | 1.10% | 1.20% | Letter | 8.52% | 5.90% | 4.80% | 4.80% | 4.80% | 5.70% | 5.30% | German | 22.54% | 25.30% | 24.10% | 24.10% | 23.90% | 24.00% | 24.30% | Diabetes | 22.16% | 25.10% | 24.30% | 24.30% | 24.10% | 24.20% | 24.00% | Sonar | 21.40% | 26.60% | 26.70% | 24.90% | 25.00% | 26.80% | 25.10% | Spambase | 6.93% | 6.80% | 6.60% | 6.60% | 6.60% | 6.80% | 6.60% | Tic-tac-toe | 15.67% | 16.40% | 13.50% | 13.20% | 13.20% | 14.50% | 13.80% | Vehicle | 21.97% | 22.80% | 22.60% | 23.30% | 23.40% | 24.40% | 23.00% | Vote | 4.40% | 4.70% | 4.40% | 4.10% | 4.30% | 4.50% | 4.50% | Optdigits | 3.20% | 3.80% | 3.60% | 3.50% | 3.60% | 3.70% | 3.50% | Count of wins | 10 | 2 | 3 | 4 | 3 | 1 | 1 | Direct wins | ā | 13 | 10.5 | 11 | 10 | 11 | 11 |
|
|