A Comparison Study on Rule Extraction from Neural Network Ensembles, Boosted Shallow Trees, and SVMs

Table 9

Average fidelity and standard deviations of the extracted rules for BST-R, DIMLP ensembles, and QSVMs.

Dataset	BST-R1	BST-R2	BST-R3	BST-R4	DIMLP-B	DIMLP-A	QSVM-L	QSVM-P3	QSVM-G
Australian Credit Appr.	94.8 0.9	94.7 0.7	94.7 0.6	94.4 0.9	97.9 0.5	96.0 0.5	100.0 0.0	98.1 0.6	99.3 0.2
Breast Cancer	98.5 0.6	98.7 0.3	98.5 0.4	98.5 0.5	98.8 0.4	98.9 0.3	98.9 0.4	98.1 0.3	98.7 0.4
Breast Cancer 2	97.3 0.4	97.6 0.4	97.5 0.7	97.6 0.5	97.4 0.6	97.3 0.7	97.2 0.5	97.1 0.8	98.1 0.4
Breast Canc. (prognostic)	87.0 2.1	88.1 2.0	88.0 2.0	88.4 1.9	91.9 1.5	94.8 1.6	91.1 1.3	93.9 0.6	92.2 1.1
Bupa Liver Disorders	88.0 1.9	87.9 1.8	87.2 1.7	86.9 1.9	93.1 0.9	94.5 1.1	91.4 1.9	85.3 1.7	89.3 1.2
Chess (kr-versus-kp)	99.2 0.2	99.6 0.1	99.8 0.1	99.8 0.1	99.6 0.1	99.8 0.1	100.0 0.0	99.7 0.1	99.6 0.1
Coronary Heart Disease	94.2 0.8	94.8 0.8	94.4 0.4	94.6 1.0	97.1 0.4	96.2 0.5	97.5 0.5	97.3 0.6	97.8 0.4
German Credit	92.4 0.6	89.8 0.9	88.8 1.1	88.5 1.0	96.2 0.8	94.1 1.3	94.4 0.7	94.4 0.8	90.0 1.0
Glass (binary)	94.1 1.6	91.5 1.8	90.9 2.7	90.1 2.7	94.4 1.3	91.4 1.1	87.1 2.5	90.7 0.8	91.6 1.4
Haberman	93.4 1.3	92.0 0.7	92.7 1.3	93.4 1.6	98.9 1.1	99.5 0.3	95.9 1.4	96.2 1.4	96.8 0.8
Heart Disease	92.8 1.5	92.1 1.6	90.7 2.4	90.3 2.8	95.2 1.2	93.9 1.8	95.4 1.3	94.5 1.2	94.4 1.9
ILPD (liver)	90.9 0.8	89.5 1.1	89.3 1.4	88.2 1.1	96.8 1.3	97.4 0.9	89.9 1.2	89.4 1.3	92.1 1.4
Ionosphere	96.0 1.2	96.0 1.3	95.9 1.2	96.0 1.0	96.1 0.6	94.6 1.3	95.6 0.8	94.8 0.8	95.5 1.0
Istanbul Stock Exch.	93.3 0.8	91.3 1.1	90.9 0.7	90.9 1.5	96.4 0.9	96.7 0.7	94.4 0.8	96.1 0.6	95.9 0.9
Labor	93.3 4.6	93.5 3.2	92.3 3.9	95.4 2.6	93.8 3.2	89.8 6.3	92.1 2.2	90.1 3.1	92.6 3.96
Musk1	91.9 1.5	92.2 0.9	91.4 1.4	90.9 1.3	91.5 0.7	88.5 0.8	92.1 1.0	91.0 0.9	87.5 1.6
Pima Indians	93.6 0.7	90.7 1.3	90.5 1.4	90.5 0.9	97.0 0.6	95.1 0.9	95.8 0.8	96.2 0.5	95.8 0.5
Promoters	88.0 3.3	87.0 3.5	87.3 3.0	90.4 3.0	92.0 2.9	87.5 2.2	85.5 3.4	85.5 3.2	88.6 4.1
Saheart	90.3 1.8	89.2 1.5	88.6 1.6	86.8 0.6	95.8 1.0	95.2 1.3	91.1 1.9	93.4 0.7	93.7 1.3
Sonar	88.8 2.7	86.8 3.0	87.2 1.9	85.5 2.1	90.6 1.2	85.1 2.2	88.4 1.5	86.0 2.7	82.7 2.0
Spect Heart	93.6 1.8	91.5 1.5	90.9 1.6	89.9 2.0	94.7 1.0	94.8 1.4	93.4 0.6	94.1 1.1	92.3 1.3
Splice junct.	96.9 0.4	97.9 0.3	97.6 0.2	97.4 0.4	96.9 0.3	98.0 0.2	95.1 0.2	95.1 0.2	91.2 0.3
Svmguide	99.4 0.1	99.1 0.1	98.9 0.1	98.9 0.1	99.7 0.1	99.4 0.1	99.3 0.1	99.2 0.0	99.4 0.1
Tictactoe	99.4 0.3	98.3 0.4	99.6 0.2	99.9 0.1	100.0 0.1	99.2 0.3	100.0 0.0	100.0 0.0	99.6 0.3
Vertebral Column	93.6 1.0	94.0 1.4	92.6 0.8	93.9 1.0	96.1 0.9	93.3 1.8	96.2 0.7	95.9 1.2	95.6 0.7