Table 4: Average predictive accuracy and standard deviations of the extracted rules for boosted shallow trees trained by modest boosting and gentle boosting.

Dataset BST-M1 BST-M2 BST-M3 BST-M4 BST-G1 BST-G2 BST-G3 BST-G4

Australian Credit Appr. 85.6 0.2 85.8 0.3 86.0 0.7 86.1 0.9 84.8 0.8 85.2 1.1 85.3 0.8 85.1 0.6
Breast Cancer 95.9 0.2 96.3 0.4 96.5 0.4 96.2 0.2 95.8 0.3 95.9 0.5 96.1 0.5 96.3 0.4
Breast Cancer 2 95.6 0.6 95.7 0.5 95.1 0.8 95.1 0.7 96.4 0.7 96.0 0.7 95.8 0.6 95.7 0.4
Breast Canc. (prognostic) 73.8 1.6 72.4 1.7 72.9 2.1 72.9 2.6 72.7 2.4 75.0 1.6 74.7 2.8 74.6 1.8
Bupa Liver Disorders 64.5 1.4 69.5 2.2 70.9 1.5 71.1 1.6 70.5 2.3 68.8 1.6 67.0 2.2 67.2 1.2
Chess (kr-versus-kp) 93.5 0.0 95.1 0.2 96.2 0.1 97.5 0.2 96.7 0.1 99.5 0.1 99.8 0.1 99.7 0.1
Coronary Heart Disease 80.5 0.7 88.8 0.4 89.2 0.7 89.4 0.3 87.7 0.7 89.2 0.9 89.0 0.6 89.1 0.9
German Credit 72.3 0.4 72.5 0.4 72.5 0.4 72.4 0.7 74.2 0.7 73.8 1.2 73.3 1.1 73.1 0.6
Glass (binary) 79.9 1.4 84.6 1.5 85.4 1.9 85.2 1.7 82.9 1.8 83.1 2.3 83.3 2.3 84.1 1.5
Haberman 75.0 1.0 74.4 0.7 74.5 0.9 74.6 1.0 72.5 1.8 66.5 1.5 64.9 2.4 65.3 1.5
Heart Disease 83.1 0.8 81.6 1.9 80.7 2.0 80.8 1.8 80.6 1.6 77.1 2.4 76.4 1.8 76.5 2.0
ILPD (liver) 70.5 0.7 69.9 0.8 69.1 0.6 69.4 0.7 69.5 1.2 69.7 1.4 69.6 1.5 69.6 1.6
Ionosphere 92.1 1.1 91.2 0.8 91.8 0.6 91.5 1.1 91.5 0.9 90.5 1.3 91.3 0.8 91.4 1.2
Istanbul Stock Exch. 77.1 0.7 75.8 0.7 76.6 0.9 76.4 0.8 75.1 1.1 73.2 1.2 72.5 1.5 72.8 1.2
Labor 83.6 1.7 84.2 2.8 87.5 4.1 84.7 3.3 81.9 2.9 86.0 3.8 84.4 3.3 82.9 4.0
Musk1 73.1 0.7 83.5 1.5 84.9 1.4 85.3 1.4 83.4 1.5 86.0 1.6 86.7 1.5 87.2 1.8
Pima Indians 75.0 0.5 76.0 0.9 75.7 0.5 75.9 0.7 75.0 0.9 72.8 0.9 72.0 1.1 72.3 1.0
Promoters 84.7 3.1 79.7 3.4 81.2 3.5 78.1 5.2 82.8 4.3 80.4 4.8 80.6 3.3 81.5 1.6
Saheart 71.4 1.2 72.2 1.4 72.3 1.1 71.7 1.3 67.2 1.1 64.5 1.8 65.3 1.8 63.0 1.5
Sonar 80.1 2.0 79.4 2.5 81.9 1.6 80.8 2.5 80.9 1.7 81.8 2.7 80.1 3.8 81.4 1.5
Spect Heart 71.0 1.2 72.1 1.0 71.4 1.3 71.6 1.7 71.4 2.0 65.4 1.8 66.1 2.0 66.3 1.9
Splice junct. 89.4 0.4 96.0 0.1 97.0 0.2 97.1 0.2 94.8 0.3 96.7 0.2 96.4 0.2 95.9 0.3
Svmguide 96.8 0.1 97.1 0.1 97.1 0.1 97.2 0.1 97.0 0.1 97.0 0.1 96.8 0.2 96.8 0.1
Tictactoe 70.0 0.2 73.5 0.4 83.2 0.7 95.1 0.9 98.3 0.1 99.3 0.2 99.8 0.2 100.0 0.0
Vertebral Column 79.2 0.7 82.8 1.6 82.3 1.5 81.8 1.0 81.6 1.6 80.3 1.2 81.0 1.1 80.6 1.5