Research Article
A Comparison Study on Rule Extraction from Neural Network Ensembles, Boosted Shallow Trees, and SVMs
Table 6
Average complexity of the extracted rules given by the number of rules and antecedents per rule for BST-M and BST-G.
| Dataset | BST-M1 | BST-M2 | BST-M3 | BST-M4 | BST-G1 | BST-G2 | BST-G3 | BST-G4 |
| Australian Credit Appr. | 2.0 1.0 | 21.6 3.6 | 24.3 3.7 | 26.5 3.8 | 49.1 4.3 | 73.4 4.5 | 74.5 4.5 | 76.8 4.5 | Breast Cancer | 13.0 2.7 | 13.6 2.9 | 17.7 3.2 | 21.5 3.3 | 22.3 3.4 | 24.8 3.5 | 25.8 3.5 | 25.7 3.5 | Breast Cancer 2 | 13.9 2.7 | 21.9 3.2 | 28.2 3.5 | 30.4 3.5 | 31.6 3.6 | 34.1 3.6 | 35.1 3.6 | 36.1 3.7 | Breast Canc. (prognostic) | 4.3 1.6 | 7.5 1.9 | 8.2 2.0 | 9.1 2.1 | 39.3 3.8 | 41.7 3.7 | 43.0 3.6 | 43.7 3.6 | Bupa Liver Disorders | 19.5 2.8 | 35.2 3.4 | 37.2 3.4 | 37.2 3.4 | 54.7 3.8 | 64.6 4.0 | 63.8 4.1 | 64.0 4.1 | Chess (kr-versus-kp) | 8.0 2.2 | 17.8 3.8 | 19.5 3.8 | 28.8 4.0 | 66.8 4.6 | 38.9 4.3 | 37.0 4.3 | 37.8 4.3 | Coronary Heart Disease | 18.9 3.0 | 36.7 3.6 | 41.4 3.7 | 46.6 3.9 | 68.5 4.5 | 78.0 4.7 | 83.2 4.6 | 91.4 4.7 | German Credit | 6.0 2.0 | 13.5 2.9 | 16.7 3.2 | 20.5 3.3 | 102.7 5.0 | 144.7 5.2 | 173.7 5.1 | 174.2 4.9 | Glass (binary) | 9.6 2.4 | 17.7 2.9 | 19.3 3.0 | 20.2 3.0 | 20.4 3.1 | 21.9 3.1 | 22.6 3.1 | 23.3 3.1 | Haberman | 3.0 1.3 | 5.2 1.7 | 14.0 1.9 | 7.7 2.0 | 27.3 3.0 | 52.0 3.4 | 65.4 3.6 | 64.3 3.7 | Heart Disease | 14.5 2.8 | 20.2 3.2 | 24.6 3.5 | 28.9 3.7 | 34.6 3.8 | 39.8 3.9 | 41.1 4.0 | 41.7 4.0 | ILPD (liver) | 3.5 1.4 | 5.1 1.7 | 8.1 2.0 | 10.2 2.3 | 78.0 4.2 | 97.5 4.4 | 97.7 4.4 | 99.4 4.3 | Ionosphere | 14.3 2.8 | 24.0 3.5 | 28.6 3.9 | 30.3 4.0 | 29.3 3.9 | 31.3 3.9 | 32.4 3.9 | 32.2 3.9 | Istanbul Stock Exch. | 9.6 2.0 | 17.1 2.5 | 21.5 2.9 | 28.7 3.3 | 58.1 3.8 | 80.3 4.0 | 79.8 4.1 | 80.7 4.1 | Labor | 6.8 2.1 | 7.8 2.2 | 7.8 2.2 | 7.6 2.2 | 8.4 2.4 | 9.5 2.5 | 9.6 2.4 | 8.3 2.2 | Musk1 | 27.4 3.4 | 44.5 4.2 | 61.9 4.5 | 70.8 4.5 | 75.0 4.5 | 76.2 4.5 | 75.2 4.5 | 78.1 4.5 | Pima Indians | 11.6 2.3 | 26.3 3.0 | 32.6 3.3 | 36.0 3.4 | 70.8 4.2 | 111.6 4.6 | 115.7 4.6 | 114.9 4.6 | Promoters | 11.4 2.7 | 19.9 3.7 | 21.7 3.8 | 23.6 3.9 | 21.5 3.8 | 23.5 3.9 | 25.4 4.0 | 25.2 3.9 | Saheart | 11.7 2.6 | 21.3 3.3 | 26.3 3.4 | 30.4 3.5 | 66.2 4.3 | 84.0 4.5 | 83.9 4.5 | 86.5 4.4 | Sonar | 21.6 3.5 | 34.0 4.1 | 35.8 4.2 | 37.2 4.2 | 37.5 4.2 | 39.8 4.2 | 41.4 4.3 | 42.3 4.3 | Spect Heart | 2.3 1.1 | 8.3 2.3 | 11.1 2.6 | 13.7 2.8 | 26.8 3.5 | 45.2 4.4 | 53.1 4.6 | 52.9 4.6 | Splice junct. | 21.7 3.3 | 63.2 4.8 | 59.4 4.7 | 63.1 4.7 | 144.5 5.8 | 119.7 5.9 | 129.9 6.0 | 148.3 6.2 | Svmguide | 26.4 2.4 | 37.4 2.8 | 40.9 2.9 | 44.5 3.1 | 68.1 3.6 | 105.1 3.8 | 157.5 4.0 | 167.4 4.0 | Tictactoe | 2.0 1.0 | 55.4 4.4 | 40.7 4.2 | 34.9 4.1 | 34.7 4.1 | 26.1 3.6 | 25.7 3.7 | 28.6 4.0 | Vertebral Column | 4.4 1.6 | 19.0 3.0 | 22.7 3.2 | 26.2 3.3 | 32.2 3.4 | 34.2 3.4 | 34.0 3.4 | 35.2 3.4 |
|
|