Centre for Software Reliability

Results for: 10003, CuttingSticks

Main parameters

Parameter C C++ Pascal Total
Number of submissions (AC, WA, or PE) 608 1088 331 2027
Number of authors 228 603 141 972
First submission correct 176 450 90 716
Last submission correct 212 551 114 877
Average number of trials per author 2.67 1.8 2.35 2.09
Average number of trials per author (excluding submissions after a correct one) 1.54 1.37 1.55 1.44
Average number of trials to correct submission 1.5 1.36 1.44 1.4
Number of different equivalence classes 92 133 65 264
Number of different score functions 61 67 22 128
Number of different equivalence classes in authors' first submissions 40 82 33 138
Number of different score functions in authors' first submissions 26 43 12 66

Parameters of the C/C++ submissions

Parameter All, 1>pfd (N=816) Correct (N=700) 0.1>=pfd>0 (N=8) 1>pfd>0.1 (N=108)
Mean SD Mean SD Mean SD Mean SD
FileSize 940 390 921 367 966 572 1060 490
LOC 41.4 14.1 40.7 13.3 43 17 46.2 18.1
#Comment lines 2.77 4.98 2.65 4.83 1 1.41 3.67 5.92
Halstead, Volume 1620 486 1620 431 2070 1550 1640 646
McCabe, CC 10.7 3.29 10.6 3.01 9.88 2.7 11.1 4.73

Correlations between parameters of correct C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
FileSize 10.7820.5170.7660.61
LOC 0.78210.210.8440.744
#Comment lines 0.5170.2110.1510.114
Halstead, Volume 0.7660.8440.15110.749
McCabe, CC 0.610.7440.1140.7491

Correlations between parameters and pfd/defects of C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
PFD 0.1220.1270.1490.01150.0519
Defects 0.08720.1130.0560.01690.0396

Effect of diversity

Average reliability improvement for 0.001<=pfd<=0.01: 152

Effect of Language diversity

Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C/C: 112
C/C++: 153
C/Pascal: 226
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C++/C: 153
C++/C++: 159
C++/Pascal: 294
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
Pascal/C: 226
Pascal/C++: 294
Pascal/Pascal: 113

Page maintained by: mjpm@csr.city.ac.uk

Page automatically generated on Mon Jan 22 13:10:00 2007