Centre for Software Reliability

Results for: 00106, Fermat

Main parameters

Parameter C C++ Pascal Total
Number of submissions (AC, WA, or PE) 2440 1879 339 4658
Number of authors 378 791 179 1348
First submission correct 162 398 40 600
Last submission correct 216 524 52 792
Average number of trials per author 6.46 2.38 1.89 3.46
Average number of trials per author (excluding submissions after a correct one) 3.23 1.63 1.73 2.09
Average number of trials to correct submission 1.75 1.5 1.37 1.56
Number of different equivalence classes 254 254 77 538
Number of different score functions 113 103 51 228
Number of different equivalence classes in authors' first submissions 107 150 44 269
Number of different score functions in authors' first submissions 51 64 25 113

Parameters of the C/C++ submissions

Parameter All, 1>pfd (N=990) Correct (N=610) 0.1>=pfd>0 (N=202) 1>pfd>0.1 (N=178)
Mean SD Mean SD Mean SD Mean SD
FileSize 1370 951 1310 772 1460 872 1450 1450
LOC 63.8 39.5 62.2 29.2 67 27.8 66.1 69.8
#Comment lines 4.37 8.74 4.03 6.91 5.46 12.4 4.33 9.28
Halstead, Volume 2430 2900 2240 1170 2460 1160 3070 6340
McCabe, CC 16.2 6.95 15.4 5.21 17.4 7.38 17.4 10.5

Correlations between parameters of correct C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
FileSize 10.8410.6350.8640.65
LOC 0.84110.4310.8320.715
#Comment lines 0.6350.43110.4060.318
Halstead, Volume 0.8640.8320.40610.685
McCabe, CC 0.650.7150.3180.6851

Correlations between parameters and pfd/defects of C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
PFD 0.04150.0246-0.0470.1070.0815
Defects 0.07880.0783-0.01610.08740.131

Effect of diversity

Average reliability improvement for 0.001<=pfd<=0.01: 94.7

Effect of Language diversity

Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C/C: 98.2
C/C++: 108
C/Pascal: 97.3
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C++/C: 108
C++/C++: 110
C++/Pascal: 105
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
Pascal/C: 97.2
Pascal/C++: 105
Pascal/Pascal: 44.2

Page maintained by: mjpm@csr.city.ac.uk

Page automatically generated on Mon Jan 22 11:28:21 2007