Operator-Based and Random Mutant Selection: Better Together

DMCA

Operator-Based and Random Mutant Selection: Better Together

Cached

Download Links

by Lingming Zhang , Milos Gligoric , Darko Marinov , Sarfraz Khurshid

Citations:

3 - 1 self

BibTeX

@MISC{Zhang_operator-basedand,
    author = {Lingming Zhang and Milos Gligoric and Darko Marinov and Sarfraz Khurshid},
    title = {Operator-Based and Random Mutant Selection: Better Together},
    year = {}
}

OpenURL

Abstract

Abstract—Mutation testing is a powerful methodology for evaluating the quality of a test suite. However, the methodology is also very costly, as the test suite may have to be executed for each mutant. Selective mutation testing is a well-studied technique to reduce this cost by selecting a subset of all mutants, which would otherwise have to be considered in their entirety. Two common approaches are operator-based mutant selection, which only generates mutants using a subset of mutation operators, and random mutant selection, which selects a subset of mutants generated using all mutation operators. While each of the two approaches provides some reduction in the number of mutants to execute, applying either of the two to medium-sized, real-world programs can still generate a huge number of mutants, which makes their execution too expensive. This paper presents eight random sampling strategies defined on top of operator-based mutant selection, and empirically validates that operator-based selection and random selection can be applied in tandem to further reduce the cost of mutation testing. The experimental results show that even sampling only 5 % of mutants generated by operator-based selection can still provide precise mutation testing results, while reducing the average mutation testing time to 6.54 % (i.e., on average less than 5 minutes for this study). I.

Keyphrases

random mutant selection operator-based selection test suite operator-based mutant selection mutation operator powerful methodology abstract mutation testing huge number average mutation random selection precise mutation well-studied technique selective mutation testing experimental result real-world program common approach

DMCA