Centre for Software Reliability

Results for: 00102, BinPacking

Main parameters

Parameter C C++ Pascal Total
Number of submissions (AC, WA, or PE) 8332 8046 1905 18283
Number of authors 2416 3062 786 6264
First submission correct 1554 2012 470 4036
Last submission correct 2157 2694 623 5474
Average number of trials per author 3.45 2.63 2.42 2.92
Average number of trials per author (excluding submissions after a correct one) 1.82 1.74 1.75 1.77
Average number of trials to correct submission 1.75 1.64 1.64 1.68
Number of different equivalence classes 771 775 205 1500
Number of different score functions 255 236 72 413
Number of different equivalence classes in authors' first submissions 363 360 121 715
Number of different score functions in authors' first submissions 164 148 59 269

Parameters of the C/C++ submissions

Parameter All, 1>pfd (N=5261) Correct (N=3842) 0.1>=pfd>0 (N=502) 1>pfd>0.1 (N=917)
Mean SD Mean SD Mean SD Mean SD
FileSize 1250 623 1240 626 1190 469 1320 678
LOC 50.7 25 50 22.8 50.2 20.7 54 34.1
#Comment lines 2.92 6.02 2.89 6.3 2.66 4.27 3.21 5.58
Halstead, Volume 2250 831 2230 816 2160 743 2410 917
McCabe, CC 11.8 6.08 11.6 5.64 12.3 5.33 12.5 7.9

Correlations between parameters of correct C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
FileSize 10.8030.6490.7520.569
LOC 0.80310.4090.7120.723
#Comment lines 0.6490.40910.3540.241
Halstead, Volume 0.7520.7120.35410.553
McCabe, CC 0.5690.7230.2410.5531

Correlations between parameters and pfd/defects of C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
PFD 0.03760.05440.002870.06870.0515
Defects 0.03120.05290.00130.05320.0702

Effect of diversity

Average reliability improvement for 0.001<=pfd<=0.01: 134

Effect of Language diversity

Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C/C: 134
C/C++: 142
C/Pascal: 164
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C++/C: 142
C++/C++: 123
C++/Pascal: 174
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
Pascal/C: 164
Pascal/C++: 174
Pascal/Pascal: 145

Page maintained by: mjpm@csr.city.ac.uk

Page automatically generated on Mon Jan 22 11:26:10 2007