Centre for Software Reliability

Results for: 00149, Forests

Main parameters

Parameter C C++ Pascal Total
Number of submissions (AC, WA, or PE) 171 240 89 500
Number of authors 36 84 40 160
First submission correct 7 37 5 49
Last submission correct 19 46 9 74
Average number of trials per author 4.75 2.86 2.23 3.13
Average number of trials per author (excluding submissions after a correct one) 2.81 2.25 2.11 2.35
Average number of trials to correct submission 2.42 1.76 1.56 1.91
Number of different equivalence classes 57 79 38 160
Number of different score functions 51 57 20 115
Number of different equivalence classes in authors' first submissions 26 39 19 74
Number of different score functions in authors' first submissions 21 33 14 56

Parameters of the C/C++ submissions

Parameter All, 1>pfd (N=111) Correct (N=47) 0.1>=pfd>0 (N=11) 1>pfd>0.1 (N=53)
Mean SD Mean SD Mean SD Mean SD
FileSize 3540 3740 3750 4170 2090 504 3650 3700
LOC 117 68.4 122 79.7 91.7 24.7 118 63.1
#Comment lines 11.2 28.2 17.2 41.4 2.18 3.03 7.77 9.91
Halstead, Volume 5220 2360 5770 2890 3810 1060 5030 1850
McCabe, CC 25.8 12.7 26.6 15.6 20.4 7.35 26.2 10.4

Correlations between parameters of correct C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
FileSize 10.8410.9520.7970.684
LOC 0.84110.7610.9530.887
#Comment lines 0.9520.76110.6820.544
Halstead, Volume 0.7970.9530.68210.88
McCabe, CC 0.6840.8870.5440.881

Correlations between parameters and pfd/defects of C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
PFD -0.01840.00807-0.0735-0.05760.0683
Defects 0.09590.0815-0.0481-0.07080.0694

Effect of diversity

Average reliability improvement for 0.001<=pfd<=0.01: 23.2

Effect of Language diversity

Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C/C: 16.1
C/C++: 35.2
C/Pascal: 32.9
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C++/C: 35.3
C++/C++: 23.8
C++/Pascal: 25.9
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
Pascal/C: 32.8
Pascal/C++: 25.9
Pascal/Pascal: 7.97

Outliers

The following programs have been excluded for analysis in the sections on parameters of C/C++ submissions, because they consist of a large lookup table: 88939.

Page maintained by: mjpm@csr.city.ac.uk

Page automatically generated on Mon Jan 22 11:40:56 2007