Test case prioritization for regression testing based on fault dependency

Kayes, Md. Imrul

doi:10.1109/icectech.2011.5941954

Cited by 22 publications

(15 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We used a metric, APFDD (Average of the Percentage Fault Dependency Detected) [19], to measure effectiveness of ComReg to the techniques described above. The APFDD quantifies how rapidly a prioritized test suite can detect dependency among faults The values of the APFDD range from 0 to 100; higher value implies faster fault dependency detection.…”

Section: Effectiveness Of Comregmentioning

confidence: 99%

“…We attempted a first step to prioritize regression testing based on fault dependency in [19]. We proposed an algorithm to prioritize test cases based on fault dependency.…”

Section: Introductionmentioning

confidence: 99%

“…We proposed an algorithm to prioritize test cases based on fault dependency. However, in [19], we only considered 1-hop neighborhood or dependencies of faults. This paper uses a fault dependency network to prioritize test cases for regression testing.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

The network of faults: a complex network approach to prioritize test cases for regression testing

Kayes

Islam

Chakareski

2015

Innovations Syst Softw Eng

View full text Add to dashboard Cite

Regression testing is performed to provide confidence that changes in a part of software do not affect other parts of the software. An execution of all existing test cases is the best way to re-establish this confidence. However, regression testing is an expensive process-there might be insufficient resources (e.g., time, workforce) to allow for the re-execution of all test cases. Regression test prioritization techniques attempt to re-order a regression test suite based on some criteria so that highest priority test cases are executed earlier.In this study, we want to prioritize test cases for regression testing based on the dependency network of faults. In software testing, it is common that some faults are consequences of other faults (leading faults). Moreover, dependent faults can be removed if and only if the leading faults have been removed. Our goal is to prioritize test cases so that test cases that exposed leading faults (the most central faults in the fault dependency network) in the system testing phase, are executed first in regression testing. We present ComReg, a test case prioritization technique based on the dependency network of faults. We model a fault dependency network as a directed graph and identify leading faults to prioritize test cases for regression testing. We use a centrality aggregation technique which considers six network representative centrality metrics to identify leading faults in the fault dependency network. We also discuss the use of fault communities to select an arbitrary percentage of the test cases from a prioritized regression test suite. We conduct a case study that evaluates the effectiveness and applicability of the proposed method. We obtain a fault dependency network from the development of a vocabulary learning software. We found that the fault network is a small-world graph with distinguishable community structure. The leading faults are common in all centralities and a re-ordering of test cases is feasible for regression testing based on those leading faults. Our method outperforms traditional regression testing prioritization techniques in detecting fault dependencies. Our modeling of the network of faults provides insights into the requirement of recognizing fault dependencies while re-ordering regression test suites for both research and practice. The dependency arXiv:1311.4176v3 [cs.SE] 26 Nov 2014Imrul Kayes and Jacob Chakareski model needs further evaluation and improvement considering associated resources (e.g., man-hours).

show abstract

Section: Effectiveness Of Comregmentioning

confidence: 99%

“…We attempted a first step to prioritize regression testing based on fault dependency in [19]. We proposed an algorithm to prioritize test cases based on fault dependency.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

The network of faults: a complex network approach to prioritize test cases for regression testing

Kayes

Islam

Chakareski

2015

Innovations Syst Softw Eng

View full text Add to dashboard Cite

show abstract

“…An approach that assumes all test case costs and fault severities are the same was presented in [23]. They proposed ordering to produce a more satisfactory order, the cost-cognizant metric that incorporates varying test case costs and fault severities.…”

Section: Introductionmentioning

confidence: 99%

“…Researchers have also proposed various approaches [17,18,19,20,21,22,23,24,25,26,27]to address the issues related to prioritization.…”

Section: Introductionmentioning

confidence: 99%

Regression Test Case Selection &PrioritizationUsing Dependence Graph and Genetic Algorithm

Musa¹,

Sultan²,

Ghani³

et al. 2014

IOSRJCE

View full text Add to dashboard Cite

Using goal–question–metric to compare research and practice perspectives on regression testing

Minhas

Koppula

Petersen

et al. 2022

J Software Evolu Process

View full text Add to dashboard Cite

Regression testing is challenging because of its complexity and the amount of effort and time it requires, especially in large-scale environments with continuous integration and delivery. Regression test selection and prioritization techniques have been proposed in the literature to address the regression testing challenges, but adoption rates of these techniques in industry are not encouraging. One of the possible reasons could be the disparity in the regression testing goals in industry and literature. This work compares the research perspective to industry practice on regression testing goals, corresponding information needs, and metrics required to evaluate these goals. We have conducted a literature review of 44 research papers and a survey with 56 testing practitioners. The survey comprises 11 interviews and 45 responses to an online questionnaire. We identified that industry and research accentuate different regression testing goals. For instance, the literature emphasizes increasing the fault detection rates of test suites and early identification of critical faults. In contrast, the practitioners' focus is on test suite maintenance, controlled fault slippage, and awareness of changes. Similarly, the literature suggests maintaining information needs from test case execution histories to evaluate regression testing techniques based on various metrics, whereas, at large, the practitioners do not use the metrics suggested in the literature. To bridge the research and practice gap, based on the literature and survey findings, we have created a goal-question-metric (GQM) model that maps the regression testing goals, associated information needs, and metrics from both perspectives. The GQM model can guide researchers in proposing new techniques closer to industry contexts. Practitioners can benefit from information needs and metrics presented in the literature and can use GQM as a tool to follow their regression testing goals.

show abstract

Test case prioritization for regression testing based on fault dependency

Cited by 22 publications

References 7 publications

The network of faults: a complex network approach to prioritize test cases for regression testing

The network of faults: a complex network approach to prioritize test cases for regression testing

Regression Test Case Selection &PrioritizationUsing Dependence Graph and Genetic Algorithm

Using goal–question–metric to compare research and practice perspectives on regression testing

Contact Info

Product

Resources

About