Research Article
Empirical Study of the Effects of Different Similarity Measures on Test Case Prioritization
Table 9
The mean value of NAPFD and the standard deviation. Columns “NV” and “SD” show the NAPFD and the standard deviation, respectively.
| Program | TCP | | | | | | | NV | SD | NV | SD | NV | SD | NV | SD | NV | SD | NV | SD |
| gzip | | 0.293 | 0.10 | 0.419 | 0.09 | 0.506 | 0.09 | 0.540 | 0.09 | 0.596 | 0.10 | 0.680 | 0.08 | | 0.426 | 0.00 | 0.626 | 0.00 | 0.751 | 0.00 | 0.813 | 0.00 | 0.851 | 0.00 | 0.875 | 0.00 | | 0.581 | 0.05 | 0.674 | 0.04 | 0.701 | 0.04 | 0.735 | 0.04 | 0.764 | 0.04 | 0.787 | 0.04 | | 0.553 | 0.06 | 0.639 | 0.04 | 0.685 | 0.04 | 0.720 | 0.04 | 0.753 | 0.05 | 0.773 | 0.04 | | 0.537 | 0.04 | 0.635 | 0.04 | 0.682 | 0.04 | 0.712 | 0.04 | 0.741 | 0.04 | 0.760 | 0.04 | | 0.432 | 0.04 | 0.505 | 0.02 | 0.527 | 0.02 | 0.565 | 0.01 | 0.615 | 0.01 | 0.669 | 0.01 |
| sed | | 0.607 | 0.07 | 0.686 | 0.06 | 0.720 | 0.06 | 0.806 | 0.03 | 0.824 | 0.03 | 0.860 | 0.03 | | 0.423 | 0.00 | 0.631 | 0.00 | 0.707 | 0.00 | 0.761 | 0.00 | 0.798 | 0.00 | 0.823 | 0.00 | | 0.646 | 0.05 | 0.697 | 0.04 | 0.755 | 0.04 | 0.803 | 0.04 | 0.846 | 0.03 | 0.859 | 0.04 | | 0.641 | 0.06 | 0.702 | 0.02 | 0.781 | 0.02 | 0.833 | 0.02 | 0.877 | 0.02 | 0.883 | 0.03 | | 0.655 | 0.01 | 0.718 | 0.02 | 0.794 | 0.02 | 0.856 | 0.02 | 0.881 | 0.02 | 0.904 | 0.02 | | 0.647 | 0.03 | 0.721 | 0.02 | 0.780 | 0.01 | 0.829 | 0.01 | 0.869 | 0.01 | 0.888 | 0.01 |
| make | | 0.726 | 0.23 | 0.801 | 0.16 | 0.871 | 0.12 | 0.904 | 0.08 | 0.924 | 0.07 | 0.942 | 0.05 | | 0.139 | 0.00 | 0.143 | 0.00 | 0.144 | 0.00 | 0.145 | 0.00 | 0.145 | 0.00 | 0.146 | 0.00 | | 0.678 | 0.26 | 0.827 | 0.17 | 0.880 | 0.09 | 0.929 | 0.06 | 0.943 | 0.05 | 0.942 | 0.06 | | 0.920 | 0.03 | 0.980 | 0.00 | 0.993 | 0.00 | 0.996 | 0.00 | 0.997 | 0.00 | 0.998 | 0.00 | | 0.923 | 0.04 | 0.980 | 0.00 | 0.993 | 0.00 | 0.996 | 0.00 | 0.997 | 0.00 | 0.998 | 0.00 | | 0.917 | 0.03 | 0.971 | 0.02 | 0.984 | 0.01 | 0.980 | 0.00 | 0.990 | 0.00 | 0.986 | 0.00 |
| totinfo | | 0.601 | 0.09 | 0.702 | 0.05 | 0.741 | 0.04 | 0.769 | 0.04 | 0.796 | 0.03 | 0.814 | 0.03 | | 0.758 | 0.00 | 0.827 | 0.00 | 0.855 | 0.00 | 0.870 | 0.00 | 0.878 | 0.00 | 0.884 | 0.00 | | 0.634 | 0.07 | 0.712 | 0.05 | 0.749 | 0.04 | 0.774 | 0.03 | 0.815 | 0.04 | 0.829 | 0.03 | | 0.653 | 0.04 | 0.734 | 0.03 | 0.771 | 0.03 | 0.789 | 0.03 | 0.853 | 0.03 | 0.882 | 0.03 | | 0.660 | 0.05 | 0.749 | 0.04 | 0.784 | 0.03 | 0.802 | 0.03 | 0.875 | 0.03 | 0.908 | 0.03 | | 0.649 | 0.06 | 0.725 | 0.05 | 0.774 | 0.05 | 0.813 | 0.04 | 0.825 | 0.03 | 0.845 | 0.03 |
| schedule | | 0.444 | 0.10 | 0.593 | 0.10 | 0.670 | 0.12 | 0.707 | 0.10 | 0.732 | 0.10 | 0.747 | 0.09 | | 0.355 | 0.00 | 0.400 | 0.00 | 0.414 | 0.00 | 0.422 | 0.00 | 0.427 | 0.00 | 0.430 | 0.00 | | 0.455 | 0.11 | 0.595 | 0.10 | 0.680 | 0.10 | 0.717 | 0.10 | 0.748 | 0.10 | 0.765 | 0.09 | | 0.546 | 0.13 | 0.672 | 0.12 | 0.719 | 0.12 | 0.746 | 0.09 | 0.791 | 0.10 | 0.817 | 0.09 | | 0.582 | 0.12 | 0.689 | 0.12 | 0.733 | 0.11 | 0.782 | 0.11 | 0.841 | 0.10 | 0.882 | 0.08 | | 0.612 | 0.04 | 0.693 | 0.04 | 0.724 | 0.01 | 0.737 | 0.01 | 0.746 | 0.01 | 0.751 | 0.01 |
| schedule2 | | 0.417 | 0.18 | 0.615 | 0.13 | 0.695 | 0.13 | 0.752 | 0.11 | 0.780 | 0.08 | 0.810 | 0.06 | | 0.186 | 0.00 | 0.193 | 0.00 | 0.195 | 0.00 | 0.197 | 0.00 | 0.197 | 0.00 | 0.198 | 0.00 | | 0.429 | 0.17 | 0.587 | 0.15 | 0.721 | 0.12 | 0.776 | 0.09 | 0.797 | 0.09 | 0.822 | 0.07 | | 0.515 | 0.15 | 0.698 | 0.12 | 0.758 | 0.10 | 0.807 | 0.09 | 0.813 | 0.05 | 0.848 | 0.06 | | 0.506 | 0.15 | 0.675 | 0.13 | 0.767 | 0.12 | 0.818 | 0.09 | 0.830 | 0.07 | 0.876 | 0.06 | | 0.576 | 0.04 | 0.699 | 0.04 | 0.749 | 0.07 | 0.789 | 0.03 | 0.807 | 0.05 | 0.827 | 0.04 |
| print_tokens | | 0.552 | 0.12 | 0.690 | 0.10 | 0.788 | 0.08 | 0.818 | 0.07 | 0.852 | 0.06 | 0.864 | 0.05 | | 0.182 | 0.00 | 0.280 | 0.00 | 0.329 | 0.00 | 0.354 | 0.00 | 0.398 | 0.00 | 0.427 | 0.00 | | 0.589 | 0.12 | 0.733 | 0.09 | 0.795 | 0.08 | 0.821 | 0.07 | 0.857 | 0.06 | 0.879 | 0.05 | | 0.716 | 0.08 | 0.803 | 0.07 | 0.840 | 0.07 | 0.867 | 0.06 | 0.888 | 0.05 | 0.906 | 0.06 | | 0.695 | 0.06 | 0.813 | 0.08 | 0.834 | 0.07 | 0.856 | 0.06 | 0.889 | 0.05 | 0.900 | 0.05 | | 0.785 | 0.02 | 0.877 | 0.02 | 0.915 | 0.01 | 0.940 | 0.00 | 0.950 | 0.00 | 0.952 | 0.00 |
| print_tokens2 | | 0.857 | 0.06 | 0.919 | 0.03 | 0.961 | 0.02 | 0.963 | 0.02 | 0.967 | 0.01 | 0.976 | 0.01 | | 0.000 | 0.00 | 0.000 | 0.00 | 0.000 | 0.00 | 0.000 | 0.00 | 0.000 | 0.00 | 0.030 | 0.00 | | 0.852 | 0.06 | 0.920 | 0.03 | 0.968 | 0.02 | 0.969 | 0.02 | 0.971 | 0.01 | 0.977 | 0.01 | | 0.926 | 0.03 | 0.965 | 0.02 | 0.986 | 0.01 | 0.987 | 0.01 | 0.991 | 0.01 | 0.992 | 0.01 | | 0.933 | 0.03 | 0.969 | 0.01 | 0.986 | 0.01 | 0.988 | 0.01 | 0.990 | 0.01 | 0.992 | 0.01 | | 0.924 | 0.02 | 0.962 | 0.01 | 0.982 | 0.01 | 0.983 | 0.00 | 0.985 | 0.00 | 0.990 | 0.00 |
|
|