Centre for Software Reliability

Results for: 10200, PrimeTime

Main parameters

Parameter C C++ Pascal Total
Number of submissions (AC, WA, or PE) 597 1149 213 2056
Number of authors 455 866 180 1527
First submission correct 379 716 130 1225
Last submission correct 439 819 137 1395
Average number of trials per author 1.31 1.33 1.18 1.35
Average number of trials per author (excluding submissions after a correct one) 1.31 1.33 1.19 1.35
Average number of trials to correct submission 1.31 1.3 1.07 1.28
Number of different equivalence classes 46 98 39 156
Number of different score functions 22 45 9 60
Number of different equivalence classes in authors' first submissions 42 67 32 118
Number of different score functions in authors' first submissions 19 33 7 45

Parameters of the C/C++ submissions

Parameter All, 1>pfd (N=1277) Correct (N=1206) 0.1>=pfd>0 (N=4) 1>pfd>0.1 (N=67)
Mean SD Mean SD Mean SD Mean SD
FileSize 2270 5760 2280 5810 2300 3190 2060 5090
LOC 77.8 340 78.4 348 53.5 25.3 67.5 144
#Comment lines 3.69 7.26 3.71 7.38 2.5 1.73 3.48 5.13
Halstead, Volume 7890 28300 7970 28600 5910 9470 6540 23000
McCabe, CC 11.2 5.03 11.3 4.9 9.75 2.22 9.34 6.92

Correlations between parameters of correct C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
FileSize 10.4870.1030.973-0.127
LOC 0.48710.01270.432-0.0723
#Comment lines 0.1030.012710.05180.0724
Halstead, Volume 0.9730.4320.05181-0.131
McCabe, CC -0.127-0.07230.0724-0.1311

Correlations between parameters and pfd/defects of C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
PFD -0.0146-0.00875-0.0475-0.0102-0.108
Defects -0.0239-0.0127-0.0341-0.024-0.066

Effect of diversity

Average reliability improvement for 0.001<=pfd<=0.01: 191

Effect of Language diversity

Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C/C: 134
C/C++: 136
C/Pascal: 216
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C++/C: 136
C++/C++: 113
C++/Pascal: 184
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
Pascal/C: 216
Pascal/C++: 185
Pascal/Pascal: 98.2

Page maintained by: mjpm@csr.city.ac.uk

Page automatically generated on Mon Jan 22 13:40:25 2007