Margin-Based Pareto Ensemble Pruning: An Ensemble Pruning Algorithm That Learns to Search Optimized Ensembles

Table 3

Average optimized ensemble size.

Data sets	Ours	RE pruning	Kappa pruning	CM pruning	MDM pruning	EA pruning
Australian	7.2	12.5	14.7	11.0	8.5	41.9
Breast-cancer	7.2	8.7	26.1	8.8	7.8	44.6
Liver	7.4	13.9	24.7	15.3	17.7	42
Heart-statlog	9.6	11.4	17.9	13.2	13.6	44.2
Waveform	9	12.3	15.6	11.7	11.5	42.4
Ionosphere	9.1	7.9	10.5	8.5	10.7	48.8
Kr-vs-kp	4.3	5.8	10.6	9.6	7.2	45.9
Letter	12.5	15.1	13.8	12.9	23.2	38.3
German	7.0	9.4	13.6	11.5	19.7	41.2
Diabetes	11.7	14.3	16.8	12.6	18.1	42.8
Sonar	13.2	11.0	20.6	13.9	20.6	43.1
Spambase	12.6	18.5	20.0	19.0	28.8	39.7
Tic-tac-toe	13.0	16.1	17.4	15.4	28.0	39.8
Vehicle	7.0	15.7	16.5	11.2	21.6	41.9
Vote	3.5	3.2	5.1	5.4	6.0	47.8
Optdigits	22.3	25.0	25.2	21.4	46.8	41.4
Count of wins	13	3	0	0	0	0
Direct wins		13	16	14	16	16