Debugging times with manual versus tool-supported experiments. The 5th column indicates the position in the ranking of the first bug-related violation (BR) (a value per fault). The 6th column is the VC length in the execution trace from the bug activation to the bug-related violation .
Group 1
Version
No. faults
Manual time
Tool time
Position of the 1st BR
VC length
N1
1
11′10′′
2′00′′
1
1
N2
3
16′20′′
9′30′′
1,1,1
3,4,1
N3
1
7′40′′
9′20′′
1
9
Manual time mean (and variance) per fault: 7′02′′ (38070′′)
Tool time mean (and variance) per fault: 4′10′′ (32350′′)
Group 2
Version
No. faults
Manual time
Tool time
Position of the 1st BR
VC length
N1
0
0
0
—
—
N2
2
23′40′′
8′10′′
1,1
3,1
N3
1
19′00′′
12′50′′
1
5
N4
1
7′20′′
13′50′′
2
1
Manual time mean (and variance) per fault: 12′30′′ (110470′′)
Tool time mean (and variance) per fault: 8′42′′ (106090′′)
Group 3
Version
No. faults
Manual time
Tool time
Position of the 1st BR
VC length
N1
3
35′00′′
9′30′′
1,1,1
3,1,4
N2
1
8′10′′
15′20′′
1
14
N3
3
24′20′′
9′50′′
1,1,1
2,2,1
Manual time mean (and variance) per fault: 9′38′′ (84681′′)
Tool time mean (and variance) per fault: 4′57′′ (81457′′)
Summary
Manual time mean (and variance) per fault: 9′32′′ (82087′′)
Tool time mean (and variance) per fault: 5′38′′ (74865′′)
