Research Article

Margin-Based Pareto Ensemble Pruning: An Ensemble Pruning Algorithm That Learns to Search Optimized Ensembles

Table 2

Test error comparison.

Data setsOursFull baggingRE pruningKappa pruningCM pruningMDM pruningEA pruning

Australian11.62%14.30%14.40%14.30%14.50%14.80%14.30%
Breast cancer23.83%27.90%27.70%28.70%29.20%29.50%27.50%
Liver25.73%32.70%32.00%32.60%30.60%33.70%31.70%
Heart-statlog23.50%19.50%18.70%20.10%19.90%19.90%19.60%
Waveform20.80%22.20%20.50%20.90%20.30%20.10%20.50%
Ionosphere5.70%9.20%8.60%8.40%8.90%10.00%9.30%
Kr-vs-kp0.90%1.50%1.00%1.00%1.10%1.10%1.20%
Letter8.52%5.90%4.80%4.80%4.80%5.70%5.30%
German22.54%25.30%24.10%24.10%23.90%24.00%24.30%
Diabetes22.16%25.10%24.30%24.30%24.10%24.20%24.00%
Sonar21.40%26.60%26.70%24.90%25.00%26.80%25.10%
Spambase6.93%6.80%6.60%6.60%6.60%6.80%6.60%
Tic-tac-toe15.67%16.40%13.50%13.20%13.20%14.50%13.80%
Vehicle21.97%22.80%22.60%23.30%23.40%24.40%23.00%
Vote4.40%4.70%4.40%4.10%4.30%4.50%4.50%
Optdigits3.20%3.80%3.60%3.50%3.60%3.70%3.50%
Count of wins10234311
Direct winsā€‰1310.511101111