Centre for Software Reliability

Results for: 10035, PrimaryArithmetic

Main parameters

Parameter C C++ Pascal Total
Number of submissions (AC, WA, or PE) 3675 4452 556 8683
Number of authors 1024 1609 213 2846
First submission correct 448 751 78 1277
Last submission correct 905 1394 140 2439
Average number of trials per author 3.59 2.77 2.61 3.05
Average number of trials per author (excluding submissions after a correct one) 2.61 2.22 2.18 2.35
Average number of trials to correct submission 2.58 2.22 2.06 2.35
Number of different equivalence classes 671 749 141 1376
Number of different score functions 416 484 95 858
Number of different equivalence classes in authors' first submissions 309 372 74 662
Number of different score functions in authors' first submissions 188 231 52 401

Parameters of the C/C++ submissions

Parameter All, 1>pfd (N=2594) Correct (N=1280) 0.1>=pfd>0 (N=475) 1>pfd>0.1 (N=839)
Mean SD Mean SD Mean SD Mean SD
FileSize 897 532 925 571 812 355 902 550
LOC 43.7 24 44.3 22.4 40.8 17.5 44.5 29
#Comment lines 1.94 4.5 2.04 5.33 1.65 3.99 1.94 3.19
Halstead, Volume 1330 790 1360 814 1190 575 1350 848
McCabe, CC 12 4.92 12.3 4.67 11.2 4 12 5.68

Correlations between parameters of correct C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
FileSize 10.8360.650.8390.729
LOC 0.83610.3850.8910.838
#Comment lines 0.650.38510.370.303
Halstead, Volume 0.8390.8910.3710.848
McCabe, CC 0.7290.8380.3030.8481

Correlations between parameters and pfd/defects of C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
PFD 0.007620.01480.02310.0152-0.0166
Defects -0.0544-0.0527-0.00994-0.0526-0.074

Effect of diversity

Average reliability improvement for 0.001<=pfd<=0.01: 16.8

Effect of Language diversity

Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C/C: 16.3
C/C++: 16.9
C/Pascal: 20.6
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C++/C: 16.9
C++/C++: 17.1
C++/Pascal: 21.3
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
Pascal/C: 20.6
Pascal/C++: 21.3
Pascal/Pascal: 24

Page maintained by: mjpm@csr.city.ac.uk

Page automatically generated on Mon Jan 22 13:12:38 2007