Research Article
Automatic Testing of Program Slicers
Table 2
Empirical evaluation of the method instantiated for Erlang.
| | | Original | Phase 1 | Phase 2 | Total | | Slicerl | e-Knife | Test-case generation | ORBS (one node at a time) | | Nodes | Time (s) | Nodes (%) | Time (s) | Nodes (%) | CutEr | Random | Iterations | Time (s) | Nodes (%) | Time (s) |
| | b1_s56Year | 820 | — | — | 3.21 | 649 (79.15) | 100% (4.93 s) | — | 10430 | 441.48 | 181 (28.54) | 449.62 | | b2_s38C | 128 | 0.87 | 95 (74.22) | 2.22 | 95 (74.22) | 100% (16.03 s) | — | 253 | 10.76 | 34 (26.56) | 29.88 | | b2_s40D | 128 | 0.88 | 98 (76.56) | 2.32 | 98 (76.56) | 100% (16.01 s) | — | 82 | 3.51 | 38 (29.69) | 22.72 | | b3_s28C | 53 | 0.82 | 35 (66.04) | 2.12 | 35 (66.04) | 100% (3.15 s) | — | 133 | 5.50 | 24 (45.28) | 11.59 | | b4_s32Abb | 87 | — | — | 2.19 | 74 (85.06) | 100% (10.45 s) | — | 193 | 8.36 | 63 (72.41) | 21.00 | | b5_s30C | 54 | 0.99 | 51 (94.44) | 2.17 | 51 (94.44) | 78% (5.03 s) | 100% (0.02 s) | 42 | 2.21 | 51 (94.44) | 10.42 | | b6_s35C | 133 | 1.02 | 62 (46.62) | 2.18 | 57 (42.86) | 100% (10.87 s) | — | 222 | 9.07 | 38 (28.57) | 23.14 | | b6_s36D | 133 | 1.01 | 49 (36.84) | 2.16 | 49 (36.84) | 100% (3.29 s) | — | 126 | 5.33 | 27 (20.30) | 11.80 | | b7_s27C | 28 | 0.95 | 22 (78.57) | 2.12 | 22 (78.57) | 100% (2.61 s) | — | 18 | 0.87 | 22 (78.57) | 6.55 | | b8_s29Deposits | 80 | 0.95 | 78 (97.50) | 2.23 | 76 (95.00) | 86% (12.69 s) | 100% (0.03 s) | 244 | 23.14 | 58 (72.50) | 39.03 | | b9_s59A | 59 | 0.81 | 57 (96.61) | 2.18 | 54 (91.53) | 100% (14.07 s) | — | 112 | 4.96 | 52 (88.14) | 22.02 | | b10_s34DB | 140 | — | — | 2.25 | 111 (79.29) | 82% (4.96 s) | 100% (0.02 s) | 253 | 43.48 | 107 (76.43) | 50.71 | | b11_s28C | 40 | 0.83 | 32 (80.00) | 2.15 | 32 (80.00) | 100% (3.96 s) | — | 28 | 1.18 | 32 (80.00) | 8.12 | | b12_s40BS | 454 | — | — | 2.52 | 118 (25.99) | — | 100% (0.03 s) | 138 | 12.56 | 117 (25.77) | 15.11 | | b12_s92A | 454 | — | — | 2.18 | 94 (20.70) | — | 100% (0.03 s) | 83 | 7.17 | 94 (20.70) | 9.38 | | b13_s38NewI | 66 | 0.94 | 46 (69.70) | 2.15 | 46 (69.70) | 100% (1.65 s) | — | 41 | 0.65 | 46 (69.70) | 5.38 | | b14_s44V | 209 | 0.93 | 79 (37.80) | 2.18 | 75 (35.89) | 100% (1.69 s) | — | 214 | 6.78 | 55 (26.32) | 11.58 | | b14_s45W | 209 | 0.96 | 89 (42.58) | 2.20 | 64 (30.62) | 67% (2.99 s) | 100% (0.83 s) | 137 | 156.76 | 49 (23.92) | 163.74 | | b14_s46Z | 209 | 0.86 | 117 (55.98) | 2.23 | 97 (46.41) | 100% (4.54 s) | — | 127 | 5.35 | 38 (18.18) | 12.98 | | b15_s65Shown | 225 | — | — | 2.40 | 195 (86.67) | — | 100% (0.04 s) | 657 | 34.97 | 183 (81.33) | 37.41 | | b16_s58C | 108 | — | — | 1.67 | 30 (27.78) | — | 100% (0.04 s) | 25 | 1.37 | 30 (27.78) | 3.09 | | b17_s54X | 79 | — | — | 1.01 | 76 (96.20) | 100% (7.38 s) | — | 408 | 38.39 | 54 (68.35) | 46.79 | | b18_s50J | 95 | — | — | 1.02 | 92 (96.84) | — | 100% (0.04 s) | 341 | 41.25 | 46 (48.42) | 42.32 | | Average | 173.52 | 0.56 | 146.61 (80.59) | 2.13 | 99.57 (65.93) | 95.17% (5.49 s) | 100% (0.12 s) | 622.04 | 37.61 | 64.91 (50.08) | 45.84 | | Median | 128 | 0.93 | 87 (94.44) | 2.18 | 75 (76.56) | 100% (4.95 s.) | 100% (0.03 s.) | 137 | 7.17 | 12 (50.00) | 45.28 | | Total | 3991 | 12.82 | 3372 (80.59) | 49.08 | 2290 (65.93) | (126.30) | (1.08 s) | 14307 | 865.09 | 1493 (50.08) | 1054.36 |
|
|
