A Comparison Study on Rule Extraction from Neural Network Ensembles, Boosted Shallow Trees, and SVMs

Table 12

Comparison on neural network ensembles with respect to Trepan [13] and G-REX [14]. Our results in the last three columns are those provided by DIMLP-B.

Dataset	NN. Acc.	Our Acc.	Trepan Acc.	G-REX Acc.	Our rules Acc.	Trepan Fid.	G-REX Fid.	Our Fid.
Aust. Cred. Appr.	84.3	86.7	84.8	85.9	86.5	92.9	92.3	97.9
Breast Cancer	96.5	97.1	95.4	95.5	96.5	96.8	97.0	98.9
Bupa Liv. Dis.	70.6	72.7	65.6	66.2	70.9	76.2	75.6	93.1
German Credit	73.1	74.0	71.8	72.6	73.6	83.9	82.5	96.2
Ionosphere	92.6	93.2	84.3	91.4	92.1	86.0	90.9	96.1
Labor	92.0	91.7	76.0	88.0	84.3	84.0	88.0	89.8
Pima Indians	74.5	76.6	75.0	74.2	76.3	86.8	84.5	97.0
Sonar	80.5	82.1	67.0	75.0	79.0	67.5	77.5	90.6
Tictactoe	91.0	98.3	79.4	83.4	98.4	80.2	87.2	100.0