Centre for Software Reliability

Results for: 00116, UnidirectionalTSP

Main parameters

Parameter C C++ Pascal Total
Number of submissions (AC, WA, or PE) 2085 3183 892 6160
Number of authors 649 987 271 1907
First submission correct 168 309 51 528
Last submission correct 344 640 98 1082
Average number of trials per author 3.21 3.22 3.29 3.23
Average number of trials per author (excluding submissions after a correct one) 2.63 2.8 2.78 2.74
Average number of trials to correct submission 3.09 2.96 3.01 3
Number of different equivalence classes 580 830 274 1548
Number of different score functions 450 611 152 1054
Number of different equivalence classes in authors' first submissions 257 355 124 662
Number of different score functions in authors' first submissions 209 269 83 481

Parameters of the C/C++ submissions

Parameter All, 1>pfd (N=1598) Correct (N=495) 0.1>=pfd>0 (N=775) 1>pfd>0.1 (N=328)
Mean SD Mean SD Mean SD Mean SD
FileSize 1800 788 1730 738 1830 729 1850 969
LOC 76.6 30.1 72.4 28.5 78.3 28.6 78.7 34.8
#Comment lines 4.49 7.29 4.55 6.9 4.49 7.15 4.39 8.15
Halstead, Volume 3480 1220 3270 1080 3600 1220 3540 1370
McCabe, CC 21.4 7.56 19.8 7.48 22.2 7.22 21.9 8.1

Correlations between parameters of correct C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
FileSize 10.8050.570.80.661
LOC 0.80510.3450.8040.785
#Comment lines 0.570.34510.3110.29
Halstead, Volume 0.80.8040.31110.773
McCabe, CC 0.6610.7850.290.7731

Correlations between parameters and pfd/defects of C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
PFD 0.04140.0487-0.004360.02440.0361
Defects 0.05080.0534-0.01540.06830.0775

Effect of diversity

Average reliability improvement for 0.001<=pfd<=0.01: 6.07

Effect of Language diversity

Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C/C: 5.53
C/C++: 6.03
C/Pascal: 5.85
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C++/C: 6.03
C++/C++: 6.47
C++/Pascal: 6.31
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
Pascal/C: 5.85
Pascal/C++: 6.31
Pascal/Pascal: 5.51

Page maintained by: mjpm@csr.city.ac.uk

Page automatically generated on Mon Jan 22 11:35:35 2007