Research Article
Automatic Testing of Program Slicers
Table 1
Comparison of the different iterations of ORBS.
| Benchmark | 1 node | 2 nodes | 3 nodes | 4 nodes | Iter | Time (s) | % | Iter | Time (s) | % | Iter | Time | % | Iter | Time (s) | % |
| b1_s56Year | 10430 | 441.48 | 28.29 | 23155 | 649.08 | 0 | 692795 | 269172.36 | 0 | — | — | — | b2_s38C | 253 | 10.76 | 26.56 | 264 | 6.08 | 0 | 1072 | 23.00 | 0 | 2714 | 53.34 | 0 | b2_s40D | 82 | 3.51 | 29.69 | 467 | 10.49 | 0 | 3460 | 73.66 | 0 | 16110 | 315.32 | 0 | b3_s28C | 133 | 5.50 | 45.28 | 136 | 3.69 | 0 | 395 | 8.76 | 0 | 621 | 15.35 | 0 | b4_s32Abb | 193 | 8.36 | 72.41 | 1453 | 36.41 | 0 | 21319 | 488.77 | 0 | 211141 | 4437.24 | 0 | b5_s30C | 42 | 2.21 | 94.44 | 758 | 18.64 | 0 | 7909 | 165.45 | 0 | 54567 | 1134.96 | 0 | b6_s35C | 222 | 9.07 | 28.57 | 414 | 10.00 | 0 | 2923 | 61.19 | 0 | 13063 | 257.84 | 0 | b6_s36D | 126 | 5.33 | 20.30 | 206 | 4.82 | 0 | 836 | 17.90 | 0 | 2039 | 39.64 | 0 | b7_s27C | 18 | 0.87 | 78.57 | 105 | 3.38 | 0 | 234 | 5.33 | 0 | 285 | 7.54 | 0 | b8_s29Deposits | 244 | 23.14 | 72.50 | 1165 | 51.24 | 0 | 15468 | 540.83 | 0 | 140135 | 4134.79 | 0 | b9_s59A | 112 | 4.96 | 88.14 | 799 | 18.83 | 0 | 8039 | 177.06 | 0 | 51658 | 1353.71 | 0 | b10_s34DB | 253 | 43.48 | 76.43 | 4383 | 225.84 | 0 | 123884 | 4651.84 | 0 | 2477094 | 81536.00 | 0 | b11_s28C | 28 | 1.18 | 80.00 | 293 | 7.00 | 0 | 1588 | 44.10 | 0 | 5509 | 133.16 | 0 | b12_s40BS | 138 | 12.56 | 25.77 | 4872 | 257.64 | 0 | 145830 | 5510.94 | 0 | 3085914 | 102958.79 | 0 | b12_s92A | 83 | 7.17 | 20.70 | 3168 | 166.99 | 0 | 74649 | 2625.25 | 0 | 1227042 | 37374.00 | 0 | b13_s38NewI | 41 | 0.65 | 69.70 | 700 | 29.19 | 0 | 6649 | 208.36 | 0 | 39929 | 1112.95 | 0 | b14_s44V | 214 | 6.78 | 26.32 | 983 | 22.33 | 0 | 11418 | 224.08 | 0 | 84958 | 1689.93 | 0 | b14_s45W | 137 | 156.76 | 23.92 | 808 | 465.78 | 0 | 8169 | 4563.61 | 0 | 54519 | 30204.37 | 0 | b14_s46Z | 127 | 5.35 | 18.18 | 357 | 8.16 | 0 | 2402 | 47.41 | 0 | 10629 | 215.53 | 0 | b15_s65Shown | 657 | 34.97 | 81.33 | 13208 | 384.85 | 0 | 661963 | 16267.98 | 0 | 23716885 | 560087.23 | 0 | b16_s58C | 25 | 1.37 | 27.78 | 241 | 13.07 | 0 | 1195 | 75.92 | 0 | 3465 | 399.11 | 0 | b17_s54X | 408 | 38.39 | 68.35 | 848 | 69.63 | 0 | 9230 | 3263.62 | 0 | — | — | — | b18_s50J | 341 | 41.25 | 48.42 | 588 | 50.01 | 0 | 4965 | 3761.92 | 0 | — | — | — | Average | 622.04 | 37.61 | 50.08 | 2581.35 | 109.27 | 0 | 78538.78 | 13564.32 | 0 | 1356446.83 | 35976.58 | 0 | Median | 137 | 7.17 | 45.28 | 758 | 22.33 | 0 | 7909 | 208.36 | 0 | 45793.50 | 1123.95 | 0 | Total | 14307 | 865.09 | 1151.67 | 59371 | 2513.15 | 0 | 1806392 | 311979.34 | 0 | 31198277 | 798490.53 | 0 |
|
|