A Comparison Study on Rule Extraction from Neural Network Ensembles, Boosted Shallow Trees, and SVMs

Table 6

Average complexity of the extracted rules given by the number of rules and antecedents per rule for BST-M and BST-G.

Dataset	BST-M1	BST-M2	BST-M3	BST-M4	BST-G1	BST-G2	BST-G3	BST-G4
Australian Credit Appr.	2.0 1.0	21.6 3.6	24.3 3.7	26.5 3.8	49.1 4.3	73.4 4.5	74.5 4.5	76.8 4.5
Breast Cancer	13.0 2.7	13.6 2.9	17.7 3.2	21.5 3.3	22.3 3.4	24.8 3.5	25.8 3.5	25.7 3.5
Breast Cancer 2	13.9 2.7	21.9 3.2	28.2 3.5	30.4 3.5	31.6 3.6	34.1 3.6	35.1 3.6	36.1 3.7
Breast Canc. (prognostic)	4.3 1.6	7.5 1.9	8.2 2.0	9.1 2.1	39.3 3.8	41.7 3.7	43.0 3.6	43.7 3.6
Bupa Liver Disorders	19.5 2.8	35.2 3.4	37.2 3.4	37.2 3.4	54.7 3.8	64.6 4.0	63.8 4.1	64.0 4.1
Chess (kr-versus-kp)	8.0 2.2	17.8 3.8	19.5 3.8	28.8 4.0	66.8 4.6	38.9 4.3	37.0 4.3	37.8 4.3
Coronary Heart Disease	18.9 3.0	36.7 3.6	41.4 3.7	46.6 3.9	68.5 4.5	78.0 4.7	83.2 4.6	91.4 4.7
German Credit	6.0 2.0	13.5 2.9	16.7 3.2	20.5 3.3	102.7 5.0	144.7 5.2	173.7 5.1	174.2 4.9
Glass (binary)	9.6 2.4	17.7 2.9	19.3 3.0	20.2 3.0	20.4 3.1	21.9 3.1	22.6 3.1	23.3 3.1
Haberman	3.0 1.3	5.2 1.7	14.0 1.9	7.7 2.0	27.3 3.0	52.0 3.4	65.4 3.6	64.3 3.7
Heart Disease	14.5 2.8	20.2 3.2	24.6 3.5	28.9 3.7	34.6 3.8	39.8 3.9	41.1 4.0	41.7 4.0
ILPD (liver)	3.5 1.4	5.1 1.7	8.1 2.0	10.2 2.3	78.0 4.2	97.5 4.4	97.7 4.4	99.4 4.3
Ionosphere	14.3 2.8	24.0 3.5	28.6 3.9	30.3 4.0	29.3 3.9	31.3 3.9	32.4 3.9	32.2 3.9
Istanbul Stock Exch.	9.6 2.0	17.1 2.5	21.5 2.9	28.7 3.3	58.1 3.8	80.3 4.0	79.8 4.1	80.7 4.1
Labor	6.8 2.1	7.8 2.2	7.8 2.2	7.6 2.2	8.4 2.4	9.5 2.5	9.6 2.4	8.3 2.2
Musk1	27.4 3.4	44.5 4.2	61.9 4.5	70.8 4.5	75.0 4.5	76.2 4.5	75.2 4.5	78.1 4.5
Pima Indians	11.6 2.3	26.3 3.0	32.6 3.3	36.0 3.4	70.8 4.2	111.6 4.6	115.7 4.6	114.9 4.6
Promoters	11.4 2.7	19.9 3.7	21.7 3.8	23.6 3.9	21.5 3.8	23.5 3.9	25.4 4.0	25.2 3.9
Saheart	11.7 2.6	21.3 3.3	26.3 3.4	30.4 3.5	66.2 4.3	84.0 4.5	83.9 4.5	86.5 4.4
Sonar	21.6 3.5	34.0 4.1	35.8 4.2	37.2 4.2	37.5 4.2	39.8 4.2	41.4 4.3	42.3 4.3
Spect Heart	2.3 1.1	8.3 2.3	11.1 2.6	13.7 2.8	26.8 3.5	45.2 4.4	53.1 4.6	52.9 4.6
Splice junct.	21.7 3.3	63.2 4.8	59.4 4.7	63.1 4.7	144.5 5.8	119.7 5.9	129.9 6.0	148.3 6.2
Svmguide	26.4 2.4	37.4 2.8	40.9 2.9	44.5 3.1	68.1 3.6	105.1 3.8	157.5 4.0	167.4 4.0
Tictactoe	2.0 1.0	55.4 4.4	40.7 4.2	34.9 4.1	34.7 4.1	26.1 3.6	25.7 3.7	28.6 4.0
Vertebral Column	4.4 1.6	19.0 3.0	22.7 3.2	26.2 3.3	32.2 3.4	34.2 3.4	34.0 3.4	35.2 3.4