Research Article
A Comparison Study on Rule Extraction from Neural Network Ensembles, Boosted Shallow Trees, and SVMs
Table 5
Average predictive accuracy and standard deviations of the extracted rules for BST-R, DIMLP ensembles, and QSVMs.
| | Dataset | BST-R1 | BST-R2 | BST-R3 | BST-R4 | DIMLP-B | DIMLP-A | QSVM-L | QSVM-P3 | QSVM-G |
| | Australian Credit Appr. | 85.2 0.9 | 85.0 0.5 | 84.8 1.0 | 84.4 0.9 | 86.5 0.5 | 84.9 0.7 | 85.6 0.2 | 85.7 0.6 | 85.6 0.3 | | Breast Cancer | 95.8 0.4 | 96.1 0.4 | 96.0 0.5 | 96.5 0.5 | 96.5 0.3 | 96.2 0.3 | 95.1 0.4 | 92.0 0.5 | 96.7 0.4 | | Breast Cancer 2 | 95.9 0.6 | 95.7 0.3 | 95.5 0.5 | 95.3 0.6 | 95.6 0.4 | 95.8 0.4 | 93.2 0.5 | 89.0 0.7 | 94.4 0.4 | | Breast Canc. (prognostic) | 72.9 1.8 | 73.6 2.2 | 75.1 2.1 | 74.3 1.6 | 79.0 1.9 | 77.7 2.1 | 77.9 1.4 | 78.5 1.8 | 77.4 2.3 | | Bupa Liver Disorders | 70.0 1.5 | 66.5 1.3 | 65.4 0.8 | 65.7 2.6 | 70.9 1.7 | 67.2 1.9 | 59.6 3.6 | 61.9 2.5 | 70.9 1.0 | | Chess (kr-versus-kp) | 96.8 0.1 | 99.7 0.1 | 99.7 0.1 | 99.7 0.1 | 99.5 0.1 | 99.7 0.1 | 90.5 0.0 | 91.9 0.1 | 94.9 0.1 | | Coronary Heart Disease | 88.0 0.8 | 88.8 0.7 | 88.6 0.8 | 89.1 0.5 | 91.6 0.5 | 92.3 0.6 | 85.4 0.4 | 87.0 0.5 | 86.5 0.5 | | German Credit | 74.2 0.5 | 73.9 0.7 | 73.2 1.2 | 72.6 0.7 | 73.6 0.6 | 72.6 1.0 | 74.8 0.8 | 75.1 0.9 | 73.0 1.3 | | Glass (binary) | 82.7 1.7 | 82.9 2.8 | 83.2 1.5 | 84.3 2.3 | 77.8 1.4 | 81.1 2.1 | 66.7 2.9 | 76.4 3.1 | 76.7 1.9 | | Haberman | 72.5 1.2 | 66.7 1.4 | 65.8 2.0 | 65.0 1.5 | 74.3 1.1 | 73.3 0.6 | 63.1 3.9 | 65.7 2.4 | 70.3 2.1 | | Heart Disease | 79.5 2.2 | 75.8 2.2 | 76.8 2.0 | 75.3 1.7 | 84.3 1.4 | 80.5 1.9 | 82.8 1.5 | 82.2 1.6 | 81.8 1.3 | | ILPD (liver) | 69.5 1.3 | 70.1 1.1 | 70.1 1.1 | 70.4 1.2 | 70.7 0.6 | 70.8 1.5 | 65.2 1.8 | 68.6 1.0 | 68.4 1.4 | | Ionosphere | 91.3 1.0 | 91.5 1.2 | 91.0 1.1 | 91.7 0.9 | 92.1 0.6 | 90.6 1.5 | 86.3 0.8 | 88.3 1.0 | 91.8 0.6 | | Istanbul Stock Exch. | 74.5 1.2 | 72.3 1.0 | 72.5 1.0 | 72.8 1.8 | 77.2 0.8 | 75.1 1.9 | 77.6 1.0 | 76.8 0.6 | 77.1 0.6 | | Labor | 83.2 3.8 | 86.3 2.3 | 86.4 3.6 | 89.6 2.7 | 84.3 5.2 | 87.4 2.1 | 88.3 2.3 | 83.6 3.1 | 89.1 3.5 | | Musk1 | 83.7 1.6 | 86.9 1.0 | 86.6 1.3 | 86.2 1.3 | 85.8 1.6 | 86.0 1.1 | 79.9 0.6 | 82.4 1.8 | 83.4 1.9 | | Pima Indians | 75.1 0.9 | 73.2 1.1 | 72.0 0.8 | 72.1 1.1 | 76.3 0.6 | 74.2 1.2 | 75.9 0.8 | 76.3 0.5 | 76.2 0.5 | | Promoters | 82.7 4.2 | 80.7 3.4 | 80.9 4.3 | 84.1 2.6 | 83.0 2.5 | 81.1 2.9 | 80.8 3.3 | 80.4 2.6 | 80.5 3.5 | | Saheart | 66.9 1.2 | 64.1 1.3 | 63.1 1.3 | 63.5 1.6 | 71.9 0.8 | 68.6 1.3 | 61.6 3.9 | 70.7 0.9 | 70.1 1.2 | | Sonar | 80.3 2.3 | 80.6 2.7 | 79.2 3.1 | 78.0 2.0 | 79.0 1.7 | 78.4 2.9 | 77.1 2.3 | 77.9 1.8 | 75.4 3.6 | | Spect Heart | 71.4 2.0 | 65.4 2.6 | 64.9 2.0 | 66.8 1.7 | 72.2 1.5 | 67.9 2.2 | 67.6 1.4 | 68.9 1.6 | 66.5 2.4 | | Splice junct. | 94.5 0.4 | 96.7 0.2 | 96.4 0.3 | 96.0 0.3 | 95.1 0.3 | 95.3 0.4 | 85.8 0.4 | 87.4 0.3 | 93.8 0.3 | | Svmguide | 97.0 0.1 | 96.9 0.1 | 96.8 0.1 | 96.7 0.2 | 96.8 0.1 | 96.9 0.1 | 92.8 0.1 | 90.3 0.1 | 93.2 0.1 | | Tictactoe | 98.3 0.1 | 99.3 0.2 | 99.9 0.1 | 100.0 0.0 | 98.4 0.0 | 98.7 0.2 | 98.3 0.0 | 98.3 0.0 | 98.9 0.1 | | Vertebral Column | 80.8 1.1 | 81.3 0.5 | 81.3 1.4 | 81.4 0.6 | 84.0 0.6 | 82.7 1.1 | 83.9 0.8 | 84.0 0.7 | 83.5 1.2 |
|
|
