Centre for Software Reliability

Results for: 10139, Factovisors

Main parameters

Parameter C C++ Pascal Total
Number of submissions (AC, WA, or PE) 396 1198 120 1714
Number of authors 120 367 41 528
First submission correct 71 201 21 293
Last submission correct 92 268 22 382
Average number of trials per author 3.3 3.26 2.93 3.25
Average number of trials per author (excluding submissions after a correct one) 2.04 2.08 1.62 2.03
Average number of trials to correct submission 1.66 1.72 1.05 1.67
Number of different equivalence classes 79 202 23 277
Number of different score functions 67 154 14 206
Number of different equivalence classes in authors' first submissions 37 94 15 130
Number of different score functions in authors' first submissions 33 73 7 97

Parameters of the C/C++ submissions

Parameter All, 1>pfd (N=452) Correct (N=268) 0.1>=pfd>0 (N=104) 1>pfd>0.1 (N=80)
Mean SD Mean SD Mean SD Mean SD
FileSize 1400 589 1380 630 1550 530 1250 465
LOC 64.7 25.4 64.9 27 67.8 22.6 59.9 22.7
#Comment lines 4.99 5.59 4.81 5.06 5.19 4.76 5.35 7.89
Halstead, Volume 1960 788 1950 826 2130 698 1740 718
McCabe, CC 18.4 6.34 18.2 6.34 20 5.94 16.8 6.5

Correlations between parameters of correct C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
FileSize 10.790.6280.8230.72
LOC 0.7910.3470.8490.829
#Comment lines 0.6280.34710.3350.292
Halstead, Volume 0.8230.8490.33510.862
McCabe, CC 0.720.8290.2920.8621

Correlations between parameters and pfd/defects of C/C++ submissions

# Comment HalsteadMcCabe
Filesize LOC lines Volume CC
PFD -0.075-0.0518-0.0319-0.0906-0.0941
Defects 0.03880.001330.01850.0003570.00339

Effect of diversity

Average reliability improvement for 0.001<=pfd<=0.01: 21.6

Effect of Language diversity

Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C/C: 20.2
C/C++: 20.7
C/Pascal: 264
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
C++/C: 20.7
C++/C++: 19.3
C++/Pascal: 379
Average reliability improvement for 0.001<=pfd<=0.01
(in the range where all exist):
Pascal/C: 264
Pascal/C++: 379
Pascal/Pascal: 43

Outliers

The following programs have been excluded for analysis in the sections on parameters of C/C++ submissions, because they consist of a large lookup table: 496000, 496436, 496470, 496966, 503495, 602478, 602480, 602481, 625177, 629836, 629857, 705964, 705965, 911547, 1011151, 1413580, 1413584, 1413619, 1413630, 1413632, 1413636, 1413638, 1421969, 1491526, 1536119, 1536121, 1586113, 1586114, 1588490, 1604354, 1604367, 1604370, 1604372, 1673987, 1673999, 1826199, 2345753, 2346474, 2370933, 2465886, 2465919, 2465929, 2465956, 2465958, 2465964, 2466506, 2466843, 2470912, 2470918, 2470930, 2471788.

Page maintained by: mjpm@csr.city.ac.uk

Page automatically generated on Mon Jan 22 13:26:53 2007