Directed test suite augmentation

Xu, Zhihong; Kim, Yun‐Ho; Kim, Moonzoo; Rothermel, Gregg; Cohen, Myra B.

doi:10.1145/1882291.1882330

Cited by 91 publications

(53 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In their work, Xu et al [61] focus on the scenario where a program has evolved into a new version through code changes in development. They consider techniques as (i) the identification of coverage requirements for this new version, given an existing test suite; and (ii) the creation of new test cases that exercise these requirements.…”

Section: Search-based Vs Concolic Approachesmentioning

confidence: 99%

A snowballing literature study on test amplification

Danglot

Vera-Pérez

et al. 2019

Journal of Systems and Software

View full text Add to dashboard Cite

The adoption of agile development approaches has put an increased emphasis on developer testing, resulting in software projects with strong test suites. These suites include a large number of test cases, in which developers embed knowledge about meaningful input data and expected properties in the form of oracles. This article surveys various works that aim at exploiting this knowledge in order to enhance these manually written tests with respect to an engineering goal (e.g., improve coverage of changes or increase the accuracy of fault localization). While these works rely on various techniques and address various goals, we believe they form an emerging and coherent field of research, which we call "test amplification". We devised a first set of papers from DBLP, looking for all papers containing "test" and "amplification" in their title. We reviewed the 70 papers in this set and selected the 4 papers that fit our definition of test amplification. We use these 4 papers as the seed for our snowballing study, and systematically followed the citation graph. This study is the first that draws a comprehensive picture of the different engineering goals proposed in the literature for test amplification. In particular, we note that the goal of test amplification goes far beyond maximizing coverage only. We believe that this survey will help researchers and practitioners entering this new field to understand more quickly and more deeply the intuitions, concepts and techniques used for test amplification.

show abstract

Section: Search-based Vs Concolic Approachesmentioning

confidence: 99%

A snowballing literature study on test amplification

Danglot

Vera-Pérez

et al. 2019

Journal of Systems and Software

View full text Add to dashboard Cite

show abstract

“…Test augmentation techniques use symbolic execution , concolic execution or genetic algorithms to derive test inputs that cover paths not executed yet. These approaches improve automatic test case generation techniques by taking advantage of the test cases manually written by developers, but suffer from the same limitations of classic automatic techniques, do not identify the setup actions necessary to execute the test cases and tend to generate a huge amount of test cases.…”

Section: Related Workmentioning

confidence: 99%

Automatic test case evolution

Mirzaaghaei

Pastore

Pezzè

2014

Software Testing Verif & Rel

View full text Add to dashboard Cite

SUMMARYSoftware systems evolve incrementally both during and after development, and many test cases become obsolete while software evolves. Updating test suites in the context of software evolution is a complex and time consuming activity. This article focuses on the problem of updating test suites automatically, and identifies eight scenarios that allow either to repair test cases or to use test cases to generate new ones, and proposes eight test evolution algorithms that automatically repair and generate test cases by adapting existing ones. This article presents a framework, TestCareAssistant (TCA), that implements the algorithms to support the evolution of test suites written in Java. The framework has been extensively evaluated on five different open source projects where it has been applied to repair 138 broken test cases, and to generate the test cases for 727 new classes and 2462 new methods. The results obtained with TCA indicate that the approach can successfully repair 90% of the broken test cases, create test cases that cover a large amount of code and complement the test cases that can be generated by state of the art techniques. Copyright © 2014 John Wiley & Sons, Ltd.

show abstract

“…To address this problem, recently, researchers started working on test suite augmentation techniques that create new test cases for areas that have been affected by changes . Apiwattanapong et al and Santelices et al presented an approach to identify areas affected by code changes using program dependence analysis and symbolic execution, and provided test requirements for changed software.…”

Section: Related Workmentioning

confidence: 99%

“…Apiwattanapong et al and Santelices et al presented an approach to identify areas affected by code changes using program dependence analysis and symbolic execution, and provided test requirements for changed software. Xu et al presented an approach to generate test cases by utilizing the existing test cases and adapting a concolic test case generation technique. Taneja et al proposed an efficient test generation technique that uses dynamic symbolic execution, eXpress, by pruning irrelevant paths.…”

Section: Related Workmentioning

confidence: 99%

An efficient regression testing approach for PHP web applications: a controlled experiment

Hossain

2014

Software Testing Verif & Rel

View full text Add to dashboard Cite

SUMMARYCompanies that provide web applications often encounter various security attacks and frequent feature‐update demands from users, and when these needs arise, companies need to fix security problems or upgrade the application with new features. These fixes often involve small patches or revisions, but still, testers need to perform regression testing on their products to ensure that the changes have not introduced new faults. Performing regression testing on the entire product, however, can be very expensive, and it is not a viable solution for companies that need a short turnaround time to release patches. One solution is focusing only on the code areas that have been changed and performing regression testing on them. By doing this, companies can provide quick patches more dependably whenever they encounter security breaches. In this paper, the authors proposed a new regression testing approach that identifies the affected areas by code changes using impact analysis and generates new test cases for the impacted areas by changes using program slices. To facilitate the approach, the researchers implemented a Hypertext Preprocessor (PHP) Analysis and Regression Testing Engine (PARTE) and performed a controlled experiment using five open source web applications with multiple versions. The results showed that this approach is effective in reducing the cost of regression testing for a frequently patched web application, and exposed ways in which that effectiveness can vary with application characteristics and versioning frequencies. Copyright © 2014 John Wiley & Sons, Ltd.

show abstract

Directed test suite augmentation

Abstract: Abstract-As

Cited by 91 publications

References 45 publications

A snowballing literature study on test amplification

A snowballing literature study on test amplification

Automatic test case evolution

An efficient regression testing approach for PHP web applications: a controlled experiment

Contact Info

Product

Resources

About