An improved method for test case prioritization by incorporating historical test case data

Khalilian, Alireza; Azgomi, Mohammad Abdollahi; Fazlalizadeh, Yalda

doi:10.1016/j.scico.2012.01.006

Cited by 46 publications

(22 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In case a test lacks a value from a particular prioritizer, that prioritizer is not included in the weighted average for that test. This is similar to what was proposed by [3], [5], [10].…”

Section: B Prioritization Priority Merging and Suite Selectionsupporting

confidence: 91%

“…However, these approaches were also neither deployed nor evaluated in industrial settings. The same is true for [5], [10], [17] which used small programs that provided useful demonstrations of proof of concept but did not provide evidence of their usefulness in practice.…”

Section: Related Workmentioning

confidence: 88%

“…Following the study by Kim and Porter, several other studies investigated history-based prioritization [3], [5], [10], [17]. However, these approaches were also neither deployed nor evaluated in industrial settings.…”

Section: Related Workmentioning

confidence: 99%

See 2 more Smart Citations

Experience Report: Automated System Level Regression Test Prioritization Using Multiple Factors

Strandberg

Sundmark

Afzal

et al. 2018

EasyChair Preprints

View full text Add to dashboard Cite

Abstract-We propose a new method of determining an effective ordering of regression test cases, and describe its implementation as an automated tool called SuiteBuilder developed by Westermo Research and Development AB. The tool generates an efficient order to run the cases in an existing test suite by using expected or observed test duration and combining priorities of multiple factors associated with test cases, including previous fault detection success, interval since last executed, and modifications to the code tested. The method and tool were developed to address problems in the traditional process of regression testing, such as lack of time to run a complete regression suite, failure to detect bugs in time, and tests that are repeatedly omitted. The tool has been integrated into the existing nightly test framework for Westermo software that runs on largescale data communication systems. In experimental evaluation of the tool, we found significant improvement in regression testing results. The re-ordered test suites finish within the available time, the majority of fault-detecting test cases are located in the first third of the suite, no important test case is omitted, and the necessity for manual work on the suites is greatly reduced.

show abstract

“…In case a test lacks a value from a particular prioritizer, that prioritizer is not included in the weighted average for that test. This is similar to what was proposed by [3], [5], [10].…”

Section: B Prioritization Priority Merging and Suite Selectionsupporting

confidence: 91%

Section: Related Workmentioning

confidence: 88%

See 1 more Smart Citation

Experience Report: Automated System Level Regression Test Prioritization Using Multiple Factors

Strandberg

Sundmark

Afzal

et al. 2018

EasyChair Preprints

View full text Add to dashboard Cite

show abstract

“…Jeffrey and Gupta [15] present an algorithm that prioritizes test cases which combined statements coverage and relevant slices of the outputs of test cases. Khalilian et al [16] prioritize test cases according to the available historical performance data which obtained from the previous test sessions. Huang et al [17] introduce a technique that uses historical execution data to prioritize test cases in a regression testing process.…”

Section: Related Workmentioning

confidence: 99%

Coverage-Based Clustering and Scheduling Approach for Test Case Prioritization

Fan

et al. 2017

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

SUMMARYRegression testing is essential for assuring the quality of a software product. Because rerunning all test cases in regression testing may be impractical under limited resources, test case prioritization is a feasible solution to optimize regression testing by reordering test cases for the current testing version. In this paper, we propose a novel test case prioritization approach that combines the clustering algorithm and the scheduling algorithm for improving the effectiveness of regression testing. By using the clustering algorithm, test cases with same or similar properties are merged into a cluster, and the scheduling algorithm helps allocate an execution priority for each test case by incorporating fault detection rates with the waiting time of test cases in candidate set. We have conducted several experiments on 12 C programs to validate the effectiveness of our proposed approach. Experimental results show that our approach is more effective than some well studied test case prioritization techniques in terms of average percentage of fault detected (APFD) values.

show abstract

“…However, one of the limitations in this process is that the fault detection efficiency of the test suite may be compromised. The test suite may contain test cases on higher priority which may not be able to detect the errors [8]. Hence, several techniques have been proposed for prioritizing the existing test cases to accelerate the rate of fault detection in regression testing.…”

Section: Introductionmentioning

confidence: 99%

An Improved History-Based Test Prioritization Technique Technique Using Code Coverage

Gupta

Mishra

Tripathi

et al. 2014

Lecture Notes in Electrical Engineering

View full text Add to dashboard Cite

Prioritization of test cases provides a way to run test cases with the highest priority earliest. Numerous empirical studies have shown that prioritization can improve a test suite's rate of fault detection. Software testers prioritize test cases, to reduce the cost of regression testing. History Based Approach is one of the methods to prioritize the test cases. This approach takes into account the history of each of the test cases of the test suite such as fault detection, number of executions and other such factors to prioritize the test cases in the coming sessions. This paper extends the above approach to the modified lines. The modified lines are being prioritized first and subsequently followed by the concerned test cases. The proposed approach has been able to detect fault faster than the previous approach with less effort in comparison to the previous approach.

show abstract

An improved method for test case prioritization by incorporating historical test case data

Cited by 46 publications

References 27 publications

Experience Report: Automated System Level Regression Test Prioritization Using Multiple Factors

Experience Report: Automated System Level Regression Test Prioritization Using Multiple Factors

Coverage-Based Clustering and Scheduling Approach for Test Case Prioritization

An Improved History-Based Test Prioritization Technique Technique Using Code Coverage

Contact Info

Product

Resources

About