Research Article

A Comparison Study on Rule Extraction from Neural Network Ensembles, Boosted Shallow Trees, and SVMs

Table 8

Average fidelity and standard deviations of the extracted rules for BST-M and BST-G.

Dataset BST-M1 BST-M2 BST-M3 BST-M4 BST-G1 BST-G2 BST-G3 BST-G4

Australian Credit Appr. 100.0 0.0 98.9 0.2 98.5 0.3 98.3 0.4 94.8 1.3 94.3 0.7 94.8 0.9 94.6 0.6
Breast Cancer 98.7 0.4 98.9 0.4 98.9 0.4 98.8 0.4 98.6 0.4 98.7 0.5 98.8 0.3 98.7 0.2
Breast Cancer 2 98.1 0.5 97.8 0.5 97.1 0.5 97.3 0.7 97.6 0.6 97.3 0.6 97.6 0.6 97.5 0.6
Breast Canc. (prognostic) 99.6 0.4 98.9 0.9 98.5 1.1 98.3 1.0 87.2 1.7 87.4 2.2 87.7 2.0 89.1 1.8
Bupa Liver Disorders 98.3 1.0 93.6 1.4 93.3 1.2 91.8 1.1 88.8 0.9 88.0 1.5 88.8 1.6 89.3 1.5
Chess (kr-versus-kp) 100.0 0.0 99.9 0.0 99.9 0.1 99.7 0.1 99.2 0.1 99.5 0.1 99.7 0.1 99.8 0.1
Coronary Heart Disease 99.6 0.2 97.7 0.5 97.0 0.7 96.9 0.8 94.2 0.7 95.2 0.6 94.6 0.5 94.0 0.3
German Credit 100.0 0.1 99.7 0.3 99.5 0.2 99.5 0.3 92.8 0.5 90.0 0.8 88.9 1.0 88.0 1.0
Glass (binary) 97.9 0.9 94.4 1.5 95.8 1.5 93.5 1.5 92.9 2.0 90.5 2.0 89.1 1.5 91.1 2.3
Haberman 100.0 0.0 99.9 0.3 99.3 0.5 99.4 0.5 93.9 1.8 92.3 1.0 92.7 1.6 93.5 1.5
Heart Disease 98.1 0.8 94.3 1.6 94.5 1.6 95.0 1.5 91.9 1.2 91.6 2.4 90.8 1.6 91.9 1.3
ILPD (liver) 100.0 0.1 99.8 0.1 99.7 0.2 99.6 0.3 91.1 1.1 90.2 1.3 89.2 1.8 89.0 1.2
Ionosphere 97.8 1.1 95.8 1.3 96.0 0.9 95.6 0.8 95.7 1.2 94.9 1.2 95.5 0.8 95.8 1.3
Istanbul Stock Exch. 99.6 0.3 98.3 0.6 98.1 0.5 96.5 1.0 92.9 0.7 91.5 1.3 90.7 1.0 91.3 1.0
Labor 93.9 3.8 93.4 2.7 93.2 3.6 95.6 3.0 91.2 3.7 90.2 2.6 93.6 3.7 95.8 1.7
Musk1 96.7 0.6 92.7 1.3 91.8 1.4 92.0 1.5 91.3 1.7 91.3 1.7 91.8 1.0 91.7 1.8
Pima Indians 99.8 0.2 98.5 0.2 97.6 0.4 97.3 0.7 93.8 0.8 90.5 1.1 91.1 1.5 90.2 1.1
Promoters 90.7 1.8 87.8 2.6 87.4 2.9 86.5 3.8 86.6 2.4 85.3 3.8 84.5 3.3 85.4 3.0
Saheart 99.4 0.4 98.1 1.0 97.5 0.9 96.8 1.3 89.9 1.7 87.6 2.2 87.9 1.2 88.0 1.6
Sonar 93.0 1.9 88.5 2.0 88.3 2.1 87.6 2.5 88.6 1.4 87.7 2.2 87.1 2.2 88.2 2.4
Spect Heart 100.0 0.0 99.1 0.6 98.4 0.4 98.5 0.6 93.5 1.6 91.5 1.1 92.3 2.0 91.3 0.9
Splice junct. 100.0 0.0 99.1 0.1 99.2 0.1 99.1 0.2 96.8 0.3 97.9 0.2 97.7 0.2 97.4 0.2
Svmguide 99.9 0.0 99.8 0.1 99.8 0.1 99.7 0.1 99.4 0.1 99.1 0.1 99.0 0.1 99.0 0.1
Tictactoe 100.0 0.0 97.1 0.4 98.6 0.4 98.5 0.5 99.2 0.3 98.3 0.3 99.7 0.1 99.9 0.1
Vertebral Column 99.9 0.3 96.6 1.1 96.0 0.9 95.4 1.0 93.7 0.9 93.1 1.3 93.3 1.7 93.2 2.0