Abstract

Abstract-We have conducted a large-scale experiment in N-version programming. A total of 27 versions of a program were prepared in-dependently from the same specification at two universities. The re-sults of executing the versions revealed that the versions were individ-ually extremely reliable but that the number of input cases in which more than one failed was substantially more than would be expected if they were statistically independent. After the versions had been executed, the failures of each version were examined and the associated faults located. In this paper we pre-sent an analysis of these faults. Our goal in undertaking this analysis was to understand better the nature of the faults. We found that in some cases the programmers made equivalent logical errors, indicating that some parts of the problem were simply more difficult than others. We also found cases in which apparently different logical errors yielded faults that caused statistically correlated failures, indicating that there are special cases in the input space that present difficulty in various parts of the solution. A formal model is presented to explain this phe-nomenon. It appears that minor differences in the software develop-ment environment, such as the use of different programming languages for the different versions, would not have a major impact in reducing the incidence of faults that cause correlated failures. Index Terms-Design diversity, fault-tolerant software, multiver-sion programming, N-version programming, software reliability. I.

Citations