Test case prioritization: an empirical study

Rothermel, Gregg; Untch, Roland H.; Chu, Chengyun; Harrold, Mary Jean

doi:10.1109/icsm.1999.792604

Cited by 450 publications

(561 citation statements)

References 15 publications

Supporting

Mentioning

527

Contrasting

Unclassified

Order By: Relevance

“…Although previous studies of test case prioritization [3], [8] have been conducted in similar settings, the set of subjects we have considered (7 programs) resulted in a considerable testing pool. These techniques were compared based on their ability to improve the rate of fault detection of test suites; this as being only one of the numerous goals, testers might chose as listed in section I.…”

Section: Discussionmentioning

confidence: 99%

“…To avoid redundant efforts, the extended data of previous literature has allowed us to assemble sample test cases [8] and prioritize test suites with APFD computations which were done manually for each technique and base program. Noting that we can have multiple APFD values for the same applied technique; thus, we represent the results in box plot diagram showing minimum and maximum APFD thresholds for each technique [1].…”

Section: B Comparative Study Using Apfdmentioning

confidence: 99%

See 1 more Smart Citation

Towards Regression Testing Constraints

Falah¹,

Marghabi²

2014

IJMO

View full text Add to dashboard Cite

Abstract-Regression testing is one of the most crucial and expensive testing process used to validate modified software and detect new faults introduced by into previously modified and tested code. To reduce the cost of regression testing, software testers may choose to prioritize their test cases to run the "important" ones, chosen by some metrics and constraints, earlier in the testing process. Various approaches have been introduced by previous researches in the form of prioritization technique focusing on specific goals of regression testing. One goal of prioritization is to increase a test suite's rate of fault detection. In this context, previous studies have shown that several prioritization techniques can significantly improve rate of fault detection, but these studies have also shown that the effectiveness of these techniques is relative to the assumptions made by the researchers concerning the testing environment. The variations observed in these experiments have mostly been linked to the subject program, test suites characteristics. This makes it difficult for testers to appropriately choose the correct prioritization technique for their testing scenarios. In this paper, regression prioritization techniques are described. Their performance, in fault detection rate, is assessed and the metrics used to assess the effect of variation through discussing experiments done in this context are specified. Then, the results are analyzed and insight about prioritization techniques selection under these constraints is provided.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: B Comparative Study Using Apfdmentioning

confidence: 99%

Towards Regression Testing Constraints

Falah¹,

Marghabi²

2014

IJMO

View full text Add to dashboard Cite

show abstract

“…From several prior empirical studies of prioritization [14], [15], [32], [33]), we learned that typically prioritization heuristics are more cost-effective compared to control techniques, but we also learned that various factors related to software, its associated artifacts (e.g., program size, test suite size, test suite granularity, and the amount of change between versions), and organization's testing environment could affect the relationships between techniques. Thus, adopting different types of test case prioritization techniques considering such factors is potentially a practical approach for organizations who have time pressure with the product release, due to the constraint budgetary problem and competitive software market.…”

Section: Discussionmentioning

confidence: 99%

“…When the student assigned relative weights, he utilized history data regarding the performance of test case prioritization techniques observed from previous several empirical studies [14], [15], [32], [33].…”

Section: Experiments Setup and Proceduresmentioning

confidence: 99%

Adaptive Regression Testing Strategy: An Empirical Study

Arafeen

2011

2011 IEEE 22nd International Symposium on Software Reliability Engineering

View full text Add to dashboard Cite

Abstract-When software systems evolve, different amounts and types of code modifications can be involved in different versions. These factors can affect the costs and benefits of regression testing techniques in different ways, and thus, there may be no single regression testing technique that is the most cost-effective technique to use on every version. To date, many regression testing techniques have been proposed, but no research has been done on the problem of helping practitioners systematically choose appropriate techniques on new versions as systems evolve. To address this problem, we propose adaptive regression testing (ART) strategies that attempt to identify the regression testing techniques that will be the most cost-effective for each regression testing session considering organization's situations and testing environment. To assess our approach, we conducted an experiment focusing on test case prioritization techniques. Our results show that prioritization techniques selected by our approach can be more cost-effective than those used by the control approaches.

show abstract

“…Test case prioritization describes the task of finding an ordering of the test cases of a given test suite such that a given goal is reached faster. The test case prioritization problem is defined by Rothermel et al [105] as follows:…”

Section: Definition 24 Test Suite Redundancy: the Redundancy R Of A Tmentioning

confidence: 99%

Testing with model checkers: a survey

Fraser

Wotawa

Ammann

2008

Software Testing Verif & Rel

146

View full text Add to dashboard Cite

Abstract.About a decade after the initial proposal to use model checkers for the generation of test cases we take a look at the achievements in this field of research. Model checkers are formal verification tools, capable of providing counterexamples to violated properties. Normally, these counterexamples are meant to guide an analyst when searching for the root cause of a property violation. They are, however, also very useful as test cases. Many different approaches have been presented, many problems have been solved, yet many issues remain. This survey paper reviews the state of the art in testing with model checkers.

show abstract

Test case prioritization: an empirical study

Abstract: Abstract

Cited by 450 publications

References 15 publications

Towards Regression Testing Constraints

Towards Regression Testing Constraints

Adaptive Regression Testing Strategy: An Empirical Study

Testing with model checkers: a survey

Contact Info

Product

Resources

About