Centre for Software Reliability

Results for: 00108, MaximumSum

Main parameters

Parameter C C++ Pascal Total
Number of submissions (AC, WA, or PE) 2776 3876 1298 7950
Number of authors 1255 1895 597 3747
First submission correct 550 851 233 1634
Last submission correct 651 1043 292 1986
Average number of trials per author 2.21 2.05 2.17 2.12
Average number of trials per author (excluding submissions after a correct one) 1.87 1.67 1.81 1.76
Average number of trials to correct submission 1.37 1.42 1.52 1.41
Number of different equivalence classes 576 894 345 1666
Number of different score functions 457 620 209 1134
Number of different equivalence classes in authors' first submissions 313 463 190 885
Number of different score functions in authors' first submissions 251 341 120 623

Parameters of the C/C++ submissions

Parameter All, 1>pfd (N=3078) Correct (N=1447) 0.1>=pfd>0 (N=855) 1>pfd>0.1 (N=776)
Mean SD Mean SD Mean SD Mean SD
FileSize 995 607 964 552 937 513 1120 764
LOC 43.1 20.1 40.2 17.5 41.9 15.4 49.8 26.6
#Comment lines 3.59 6.93 3.61 6.01 3.35 7.4 3.8 7.92
Halstead, Volume 1700 780 1640 715 1610 586 1910 1010
McCabe, CC 13.7 4.98 13.2 4.28 13.4 4.07 14.8 6.66

Correlations between parameters of correct C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
FileSize 10.7730.6270.8110.715
LOC 0.77310.2580.810.789
#Comment lines 0.6270.25810.2770.243
Halstead, Volume 0.8110.810.27710.832
McCabe, CC 0.7150.7890.2430.8321

Correlations between parameters and pfd/defects of C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
PFD 0.05330.123-0.03690.07760.0675
Defects 0.04420.12-0.04140.07180.0874

Effect of diversity

Average reliability improvement for 0.001<=pfd<=0.01: 58.4

Effect of Language diversity

Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C/C: 48.2
C/C++: 63.3
C/Pascal: 59.4
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C++/C: 63.3
C++/C++: 58.3
C++/Pascal: 60.5
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
Pascal/C: 59.4
Pascal/C++: 60.5
Pascal/Pascal: 44.1

Page maintained by: mjpm@csr.city.ac.uk

Page automatically generated on Mon Jan 22 11:31:59 2007