Research Article

Margin-Based Pareto Ensemble Pruning: An Ensemble Pruning Algorithm That Learns to Search Optimized Ensembles

Table 4

Test errors in the noisy classification problem.

NoiseData setsOurs (%)Full bagging (%)RE pruning (%)Kappa pruning (%)CM pruning (%)MDM pruning (%)EA pruning (%)

0.00Diabetes22.1025.1024.3024.3024.3024.2024.00
German22.5025.3024.1024.1023.9024.0024.30
Heart-statlog23.5019.5018.7020.1019.9019.9019.60
Ionosphere5.709.208.608.408.9010.009.30
Sonar21.4026.6026.7024.9025.0026.8025.10
Vehicle21.9022.8022.6023.3023.4024.4023.00
Waveform20.8022.2020.5020.9020.3020.1020.50

0.02Diabetes24.2026.6026.6026.3026.7026.4027.00
German24.4027.7027.7028.1027.0027.1027.60
Heart-statlog24.3023.2022.7021.6022.0022.2023.10
Ionosphere7.2013.1011.8013.0011.5011.3012.20
Sonar23.4028.1024.0026.2024.6023.5025.30
Vehicle25.8033.0029.9029.9029.6030.1029.80
Waveform25.2026.8024.3025.8024.2023.9024.50

0.04Diabetes27.3030.1029.6029.7029.6029.4030.10
German29.1031.0030.1031.3029.9029.7030.70
Heart-statlog28.0028.2028.1026.5027.5027.5028.00
Ionosphere11.4017.7015.8018.3015.7015.9017.50
Sonar25.1030.1028.1029.6027.7025.9028.30
Vehicle25.1030.1028.1029.6027.7025.9028.30
Waveform27.5030.1028.1029.2027.9027.6028.60

0.08Diabetes27.5030.1028.1029.2027.9027.6028.60
German33.6036.2036.1036.4035.9036.1038.20
Heart-statlog32.4033.4032.6032.9033.2033.3034.40
Ionosphere26.4027.5026.5027.6026.6026.5027.90
Sonar32.3036.1036.5038.4035.7036.4036.50
Vehicle38.7043.0040.6042.0040.5040.2041.60
Waveform34.3037.6035.8036.8035.6035.3037.40