Centre for Software Reliability

Results for: 00100, 3n+1

Main parameters

Parameter C C++ Pascal Total
Number of submissions (AC, WA, or PE) 16844 17521 4337 38702
Number of authors 5897 6097 1581 13575
First submission correct 2479 2434 593 5506
Last submission correct 5140 5082 1088 11310
Average number of trials per author 2.86 2.87 2.74 2.85
Average number of trials per author (excluding submissions after a correct one) 2.66 2.68 2.58 2.66
Average number of trials to correct submission 2.65 2.66 2.53 2.65
Number of different equivalence classes 1003 1079 384 1991
Number of different score functions 276 322 112 506
Number of different equivalence classes in authors' first submissions 527 527 198 1012
Number of different score functions in authors' first submissions 152 160 58 258

Parameters of the C/C++ submissions

Parameter All, 1>pfd (N=11519) Correct (N=5368) 0.1>=pfd>0 (N=250) 1>pfd>0.1 (N=5901)
Mean SD Mean SD Mean SD Mean SD
FileSize 738 1380 757 1090 725 352 722 1620
LOC 36.9 37.3 39.6 49.1 40.4 12.9 34.3 22.3
#Comment lines 2.52 11.4 2.89 14.5 1.97 4.91 2.2 7.92
Halstead, Volume 1100 5580 1050 3960 1010 375 1150 6820
McCabe, CC 9.47 3.2 10.1 3.25 11.1 3.91 8.85 2.98

Correlations between parameters of correct C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
FileSize 10.7360.5150.8220.383
LOC 0.73610.04090.8940.32
#Comment lines 0.5150.040910.04240.0808
Halstead, Volume 0.8220.8940.042410.252
McCabe, CC 0.3830.320.08080.2521

Correlations between parameters and pfd/defects of C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
PFD -0.0159-0.0744-0.0650.00746-0.208
Defects -0.014-0.0492-0.05010.00299-0.121

Effect of diversity

Average reliability improvement for 0.001<=pfd<=0.01: 87.6

Effect of Language diversity

Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C/C: 78.4
C/C++: 87.5
C/Pascal: 165
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C++/C: 87.5
C++/C++: 89.1
C++/Pascal: 186
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
Pascal/C: 165
Pascal/C++: 186
Pascal/Pascal: 144

Outliers

The following programs have been excluded for analysis in the sections on parameters of C/C++ submissions, because they consist of a large lookup table: 1222707, 1223123, 1223215.

Page maintained by: mjpm@csr.city.ac.uk

Page automatically generated on Mon Jan 22 11:23:14 2007