DEMINER: test generation for high test coverage through mutant exploration

Abstract

Summary Most software testing techniques test a target program as it is and fail to utilize valuable information of diverse test executions on many variants/mutants of the original program in test generation. This paper proposes a new test generation technique DEMINER, which utilizes mutant executions to guide test generation on the original program for high test coverage. DEMINER first generates various mutants of an original target program and then extracts runtime information of mutant executions, which covered unreached branches by the mutation effects. Using the obtained runtime information, DEMINER inserts guideposts, artificial branches to replay the observed mutation effects, to the original target programs. Finally, DEMINER runs automated test generation on the original program with guideposts and achieves higher test coverage. We implemented DEMINER for C programs through software mutation and guided test generation such as concolic testing and fuzzing. We have shown the effectiveness of DEMINER on six real‐world target programs: Busybox‐ls, Busybox‐printf, Coreutils‐sort, GNU‐find, GNU‐grep and GNU‐sed. The experiment results show that DEMINER improved branch coverage by 63.4% and 19.6% compared with those of the conventional concolic testing techniques and the conventional fuzzing techniques on average, respectively.

Shift left testing paradigm process implementation for quality of software based on fuzzy

“…Data, information, and knowledge generated and exchanged digitally are becoming increasingly important in the digital era. Information and communications technology are the foundation of this era's infrastructure [29]. This new infrastructure is enabling new ways of controlling, coordinating, and collaborating on operations more easily, at lower costs, regulated by the rule of declining costs, in a more efficient manner than in earlier ages [30].…”

A survey on software test automation return on investment, in organizations predominantly from Bengaluru, India

“…[36][37][38][39] Model-based automated test generation is used for high coverage, and keyword-driven GUI tests are user-friendly. [40][41][42] UML-based test generation for textual and visual patterns for generating tests is used for functional test coverage. 43 With DevOps, the adoption of continuous integration and development became imperative for automated code deployments.…”