A Comparison Study on Rule Extraction from Neural Network Ensembles, Boosted Shallow Trees, and SVMs

Table 7

Average complexity of the extracted rules given by the number of rules and antecedents per rule for BST-R DIMLPs and QSVMs.

Dataset	BST-R1	BST-R2	BST-R3	BST-R4	DIMLP-B	DIMLP-A	QSVM-L	QSVM-P3	QSVM-G
Australian Credit Appr.	49.6 4.3	72.9 4.5	74.4 4.5	76.9 4.4	22.7 3.7	82.7 5.1	2.0 1.0	20.5 3.7	8.3 2.6
Breast Cancer	23.3 3.4	24.3 3.4	25.3 3.5	25.9 3.5	12.5 2.7	25.2 3.6	13.2 3.0	22.7 3.5	11.6 2.9
Breast Cancer 2	32.4 3.6	35.0 3.6	35.9 3.6	36.0 3.6	20.8 3.1	27.2 3.3	18.9 3.0	20.9 3.1	16.3 3.1
Breast Canc. (prognostic)	39.4 3.8	41.8 3.6	42.5 3.6	43.5 3.5	12.6 2.8	24.6 3.5	17.9 3.3	15.9 3.1	26.1 3.6
Bupa Liver Disorders	55.8 3.8	64.7 4.0	65.1 4.1	65.4 4.1	36.9 3.3	31.8 3.2	39.2 3.3	62.9 3.9	45.6 3.7
Chess (kr-versus-kp)	67.5 4.7	35.3 4.2	37.5 4.3	37.6 4.2	32.5 4.0	36.3 4.2	8.7 2.4	25.3 3.6	29.0 3.9
Coronary Heart Disease	68.6 4.5	79.6 4.6	81.6 4.5	81.3 4.5	44.8 4.0	71.6 4.6	41.9 3.8	42.0 3.7	34.7 3.6
German Credit	104.3 5.0	149.4 5.1	177.6 5.0	178.9 4.8	56.7 4.3	93.9 5.1	77.4 5.3	85.4 5.4	170.6 5.7
Glass (binary)	20.7 3.0	22.4 3.1	23.3 3.1	24.7 3.0	13.7 2.7	19.9 3.2	26.2 3.1	16.8 2.9	16.1 3.0
Haberman	28.7 3.0	54.9 3.5	65.5 3.6	65.7 3.7	7.8 1.9	2.3 0.6	11.1 2.3	15.4 2.7	11.2 2.5
Heart Disease	35.5 3.9	40.3 3.9	40.5 4.0	41.0 3.9	20.6 3.2	39.3 4.2	18.1 3.2	20.3 3.2	19.5 3.1
ILPD (liver)	78.0 4.2	97.7 4.4	100.0 4.3	102.2 4.3	23.9 3.1	25.2 2.8	72.8 4.1	67.3 4.0	56.2 3.9
Ionosphere	30.3 3.9	31.5 3.9	32.5 3.9	32.5 3.9	19.3 2.9	29.5 3.2	20.5 3.2	20.9 3.2	24.2 3.4
Istanbul Stock Exch.	58.5 3.8	79.6 4.0	79.1 4.0	79.7 4.1	21.4 2.8	23.4 2.9	30.0 3.0	26.6 3.1	26.1 3.1
Labor	8.6 2.3	10.1 2.6	10.3 2.5	9.8 2.5	7.3 2.2	9.2 2.6	4.3 1.7	4.9 1.8	9.8 2.6
Musk1	73.8 4.5	74.8 4.5	77.2 4.5	80.2 4.4	57.4 4.4	90.1 4.3	50.9 4.1	50.7 4.1	89.2 4.4
Pima Indians	71.5 4.3	113.5 4.6	117.0 4.6	117.5 4.5	38.8 3.3	47.0 3.6	46.1 3.4	37.5 3.3	44.4 3.5
Promoters	22.2 3.8	24.4 3.9	23.2 3.8	23.0 3.7	11.8 2.7	20.4 3.4	15.0 3.1	15.2 3.2	22.4 3.5
Saheart	65.6 4.3	84.1 4.4	85.5 4.4	85.5 4.4	29.2 3.3	27.5 3.3	54.1 3.8	37.5 3.8	38.6 3.8
Sonar	38.1 4.2	41.1 4.3	42.4 4.3	44.5 4.3	24.1 3.2	40.2 3.8	28.3 3.9	29.7 3.8	42.3 3.9
Spect Heart	26.9 3.5	45.9 4.4	52.8 4.6	53.6 4.6	20.4 3.2	26.8 3.6	21.2 3.3	25.0 3.5	40.0 4.3
Splice junct.	144.9 5.8	120.9 5.9	130.8 6.0	147.1 6.2	108.3 5.5	172.6 6.4	223 6.0	209.9 6.0	166.2 6.6
Svmguide	72.5 3.6	109.3 3.8	166.8 3.9	169.6 4.0	38.0 2.9	69.8 3.2	99.1 3.5	91.9 3.3	90.7 3.5
Tictactoe	34.1 4.0	25.9 3.6	29.9 4.1	30.5 4.1	27.3 3.7	32.8 3.8	24.8 3.6	24.8 3.6	27.2 3.8
Vertebral Colum	33.8 3.4	34.4 3.4	34.5 3.4	34.5 3.4	16.7 2.7	27.8 3.2	17.1 2.8	18.3 2.8	17.9 2.8