Research Article
A Comparison Study on Rule Extraction from Neural Network Ensembles, Boosted Shallow Trees, and SVMs
Table 7
Average complexity of the extracted rules given by the number of rules and antecedents per rule for BST-R DIMLPs and QSVMs.
| Dataset | BST-R1 | BST-R2 | BST-R3 | BST-R4 | DIMLP-B | DIMLP-A | QSVM-L | QSVM-P3 | QSVM-G |
| Australian Credit Appr. | 49.6 4.3 | 72.9 4.5 | 74.4 4.5 | 76.9 4.4 | 22.7 3.7 | 82.7 5.1 | 2.0 1.0 | 20.5 3.7 | 8.3 2.6 | Breast Cancer | 23.3 3.4 | 24.3 3.4 | 25.3 3.5 | 25.9 3.5 | 12.5 2.7 | 25.2 3.6 | 13.2 3.0 | 22.7 3.5 | 11.6 2.9 | Breast Cancer 2 | 32.4 3.6 | 35.0 3.6 | 35.9 3.6 | 36.0 3.6 | 20.8 3.1 | 27.2 3.3 | 18.9 3.0 | 20.9 3.1 | 16.3 3.1 | Breast Canc. (prognostic) | 39.4 3.8 | 41.8 3.6 | 42.5 3.6 | 43.5 3.5 | 12.6 2.8 | 24.6 3.5 | 17.9 3.3 | 15.9 3.1 | 26.1 3.6 | Bupa Liver Disorders | 55.8 3.8 | 64.7 4.0 | 65.1 4.1 | 65.4 4.1 | 36.9 3.3 | 31.8 3.2 | 39.2 3.3 | 62.9 3.9 | 45.6 3.7 | Chess (kr-versus-kp) | 67.5 4.7 | 35.3 4.2 | 37.5 4.3 | 37.6 4.2 | 32.5 4.0 | 36.3 4.2 | 8.7 2.4 | 25.3 3.6 | 29.0 3.9 | Coronary Heart Disease | 68.6 4.5 | 79.6 4.6 | 81.6 4.5 | 81.3 4.5 | 44.8 4.0 | 71.6 4.6 | 41.9 3.8 | 42.0 3.7 | 34.7 3.6 | German Credit | 104.3 5.0 | 149.4 5.1 | 177.6 5.0 | 178.9 4.8 | 56.7 4.3 | 93.9 5.1 | 77.4 5.3 | 85.4 5.4 | 170.6 5.7 | Glass (binary) | 20.7 3.0 | 22.4 3.1 | 23.3 3.1 | 24.7 3.0 | 13.7 2.7 | 19.9 3.2 | 26.2 3.1 | 16.8 2.9 | 16.1 3.0 | Haberman | 28.7 3.0 | 54.9 3.5 | 65.5 3.6 | 65.7 3.7 | 7.8 1.9 | 2.3 0.6 | 11.1 2.3 | 15.4 2.7 | 11.2 2.5 | Heart Disease | 35.5 3.9 | 40.3 3.9 | 40.5 4.0 | 41.0 3.9 | 20.6 3.2 | 39.3 4.2 | 18.1 3.2 | 20.3 3.2 | 19.5 3.1 | ILPD (liver) | 78.0 4.2 | 97.7 4.4 | 100.0 4.3 | 102.2 4.3 | 23.9 3.1 | 25.2 2.8 | 72.8 4.1 | 67.3 4.0 | 56.2 3.9 | Ionosphere | 30.3 3.9 | 31.5 3.9 | 32.5 3.9 | 32.5 3.9 | 19.3 2.9 | 29.5 3.2 | 20.5 3.2 | 20.9 3.2 | 24.2 3.4 | Istanbul Stock Exch. | 58.5 3.8 | 79.6 4.0 | 79.1 4.0 | 79.7 4.1 | 21.4 2.8 | 23.4 2.9 | 30.0 3.0 | 26.6 3.1 | 26.1 3.1 | Labor | 8.6 2.3 | 10.1 2.6 | 10.3 2.5 | 9.8 2.5 | 7.3 2.2 | 9.2 2.6 | 4.3 1.7 | 4.9 1.8 | 9.8 2.6 | Musk1 | 73.8 4.5 | 74.8 4.5 | 77.2 4.5 | 80.2 4.4 | 57.4 4.4 | 90.1 4.3 | 50.9 4.1 | 50.7 4.1 | 89.2 4.4 | Pima Indians | 71.5 4.3 | 113.5 4.6 | 117.0 4.6 | 117.5 4.5 | 38.8 3.3 | 47.0 3.6 | 46.1 3.4 | 37.5 3.3 | 44.4 3.5 | Promoters | 22.2 3.8 | 24.4 3.9 | 23.2 3.8 | 23.0 3.7 | 11.8 2.7 | 20.4 3.4 | 15.0 3.1 | 15.2 3.2 | 22.4 3.5 | Saheart | 65.6 4.3 | 84.1 4.4 | 85.5 4.4 | 85.5 4.4 | 29.2 3.3 | 27.5 3.3 | 54.1 3.8 | 37.5 3.8 | 38.6 3.8 | Sonar | 38.1 4.2 | 41.1 4.3 | 42.4 4.3 | 44.5 4.3 | 24.1 3.2 | 40.2 3.8 | 28.3 3.9 | 29.7 3.8 | 42.3 3.9 | Spect Heart | 26.9 3.5 | 45.9 4.4 | 52.8 4.6 | 53.6 4.6 | 20.4 3.2 | 26.8 3.6 | 21.2 3.3 | 25.0 3.5 | 40.0 4.3 | Splice junct. | 144.9 5.8 | 120.9 5.9 | 130.8 6.0 | 147.1 6.2 | 108.3 5.5 | 172.6 6.4 | 223 6.0 | 209.9 6.0 | 166.2 6.6 | Svmguide | 72.5 3.6 | 109.3 3.8 | 166.8 3.9 | 169.6 4.0 | 38.0 2.9 | 69.8 3.2 | 99.1 3.5 | 91.9 3.3 | 90.7 3.5 | Tictactoe | 34.1 4.0 | 25.9 3.6 | 29.9 4.1 | 30.5 4.1 | 27.3 3.7 | 32.8 3.8 | 24.8 3.6 | 24.8 3.6 | 27.2 3.8 | Vertebral Colum | 33.8 3.4 | 34.4 3.4 | 34.5 3.4 | 34.5 3.4 | 16.7 2.7 | 27.8 3.2 | 17.1 2.8 | 18.3 2.8 | 17.9 2.8 |
|
|