Centre for Software Reliability

Results for: 10038, JollyJumpers

Main parameters

Parameter C C++ Pascal Total
Number of submissions (AC, WA, or PE) 2102 3497 553 6152
Number of authors 651 1400 191 2242
First submission correct 257 622 9 888
Last submission correct 469 962 17 1448
Average number of trials per author 3.23 2.5 2.9 2.74
Average number of trials per author (excluding submissions after a correct one) 2.59 2.2 2.68 2.36
Average number of trials to correct submission 2.65 2.01 3.53 2.23
Number of different equivalence classes 480 765 161 1265
Number of different score functions 328 456 36 698
Number of different equivalence classes in authors' first submissions 195 340 74 549
Number of different score functions in authors' first submissions 146 216 18 325

Parameters of the C/C++ submissions

Parameter All, 1>pfd (N=2011) Correct (N=909) 0.1>=pfd>0 (N=389) 1>pfd>0.1 (N=713)
Mean SD Mean SD Mean SD Mean SD
FileSize 655 331 665 368 639 218 652 331
LOC 34.6 14 34 15.4 36.3 11.5 34.3 13.3
#Comment lines 1.59 3.38 1.72 3.8 1.49 3.11 1.48 2.93
Halstead, Volume 969 395 981 426 997 258 938 414
McCabe, CC 10.2 3.02 10.1 2.51 11 3.18 9.78 3.41

Correlations between parameters of correct C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
FileSize 10.8650.6630.8630.543
LOC 0.86510.4960.8870.649
#Comment lines 0.6630.49610.4870.258
Halstead, Volume 0.8630.8870.48710.667
McCabe, CC 0.5430.6490.2580.6671

Correlations between parameters and pfd/defects of C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
PFD 0.007740.001750.00523-0.0461-0.0775
Defects -0.0405-0.0333-0.0269-0.0637-0.0685

Effect of diversity

Average reliability improvement for 0.001<=pfd<=0.01: 18.4

Effect of Language diversity

Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C/C: 17.7
C/C++: 18
C/Pascal: 23.1
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C++/C: 18
C++/C++: 17.9
C++/Pascal: 23.3
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
Pascal/C: 23.1
Pascal/C++: 23.3
Pascal/Pascal: 15.4

Page maintained by: mjpm@csr.city.ac.uk

Page automatically generated on Mon Jan 22 13:14:58 2007