An algorithm for generating t-wise covering arrays from large feature models

Johansen, Martin Fagereng; Haugen, Øystein; Fleurey, Franck

doi:10.1145/2362536.2362547

Cited by 191 publications

(138 citation statements)

References 18 publications

Supporting

Mentioning

138

Contrasting

Order By: Relevance

“…Running all the test cases in an existing test suite can results in a large amount of effort or even become infeasible due to deadlines and cost constraints. It may take few days to complete the test configuration generation on an SPL using CIT even with low (2 or 3) twise covering array (Johansen et al, 2012a). To tackle this, Combinatorial Interaction Testing techniques that employ systematic selection, objective prioritization, or combination of both have been proposed by many and are still an active research area.…”

Section: Test Selection and Prioritizationmentioning

confidence: 99%

“…One of the main strengths of CIT is that it enables a significant reduction of the number of test cases without compromising functional coverage. Similarly, in SPL, several works have been reported that apply and evaluate the effectiveness of CIT to reduce the testing effort by selecting a set of representative products (Johansen et al, 2012a;2012d;Galindo et al, 2014). This paper is structured as follows; in section 2, the details on the systematic mapping process are presented, which includes definition of the research questions, conducting the search process, filtering the evidences based on selection criteria and extracting particulars from selected primary studies into different categorizations.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Combinatorial Interaction Testing of Software Product Lines: A Mapping Study

Sahid¹,

Sultan²,

Ghani³

et al. 2016

Journal of Computer Science

View full text Add to dashboard Cite

Software Product Line (SPL) is a software engineering paradigm that is inspired by the concept of reusability of common features, formulated for different software product. Complete testing on entire SPL is known to be unfeasible, due to the very large number of possible products to be produced, configured using a subset or all possible features in the SPL. This paper reports a Systematic Mapping Study (SMS) of relevant primary studies as the evidence on the application of Combinatorial Interaction Testing (CIT) for SPL. In CIT, one has to construct a covering array, which is a set of configurations having valid feature combinations and every combination of t features appears at least once in the array. This is also known as t-wise testing. By following the systematic mapping study guidelines, we have selected and filtered 44 primary studies for review. The most prominent CIT techniques in aiding SPL testing are those based on greedy algorithms followed by meta-heuristics algorithms. The motivation of SPL testing is to anticipate the feature interaction problem, in which the majority of the works were reported to leverage test configuration selection approach, while some employed test configuration prioritization approach. Numerous works have been reported, but only few works managed to demonstrate their scalability, as most primary studies only deal with low strength (t is less than 4) of t-wise testing.

show abstract

Section: Test Selection and Prioritizationmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Combinatorial Interaction Testing of Software Product Lines: A Mapping Study

Sahid¹,

Sultan²,

Ghani³

et al. 2016

Journal of Computer Science

View full text Add to dashboard Cite

show abstract

“…Second, the t-wise covering array must be generated. We have developed an algorithm that can generate such arrays from large features models [3] 3 . These products must then be generated or physically built.…”

Section: Reusable Component Testingmentioning

confidence: 99%

“…Combinatorial interaction testing is to first construct a small set of products, called a covering array, in which interaction faults are most likely to show up and then to test these products normally. We have previously advanced this approach by showing that generating covering arrays from realistic features models is tractable [2] and by providing an algorithm that allows generating covering arrays for product lines of the size and complexity found in industry [3].…”

Section: Introductionmentioning

confidence: 99%

A Technique for Agile and Automatic Interaction Testing for Product Lines

Johansen¹,

Haugen²,

Fleurey³

et al. 2012

Testing Software and Systems

Self Cite

View full text Add to dashboard Cite

Abstract. Product line developers must ensure that existing and new features work in all products. Adding to or changing a product line might break some of its features. In this paper, we present a technique for automatic and agile interaction testing for product lines. The technique enables developers to know if features work together with other features in a product line, and it blends well into a process of continuous integration. The technique is evaluated with two industrial applications, testing a product line of safety devices and the Eclipse IDEs. The first case shows how existing test suites are applied to the products of a 2-wise covering array to identify two interaction faults. The second case shows how over 400,000 test executions are performed on the products of a 2-wise covering array using over 40,000 existing automatic tests to identify potential interactions faults.

show abstract

“…When the number of products is too large, testing all the products is unfeasible. This could be addressed by using, e.g., sample-based SPL testing techniques [21,20,27,23], where a subset of products-covering relevant combinations of features-is generated and tested by applying single system testing techniques.…”

Section: Introductionmentioning

confidence: 99%

A novel model-based testing approach for software product lines

et al. 2016

View full text Add to dashboard Cite

A novel model-based testing approach for software product lines / Damiani, Ferruccio; Faitelson, David; Gladisch, Christoph; Tyszberowicz, Shmuel. -In: SOFTWARE AND SYSTEMS MODELING. -ISSN 1619-ISSN -1366-ISSN . -14:4(2017, pp. 1223-1251. Original Citation:A novel model-based testing approach for software product lines Abstract Model-based testing relies on a model of the system under test. FineFit is a framework for model-based testing of Java programs. In the FineFit approach, the model is expressed by a set of tables based on Parnas tables. A software product line is a family of programs (the products) with well-defined commonalities and variabilities that are developed by (re)using common artifacts. In this paper we address the issue of using the FineFit approach to support the development of correct software product lines. We specify a software product line as a specification product line where each product is a FineFit specification of the corresponding software product. The main challenge is to concisely specify the software product line while retaining the readability of the specification of a single system. To address this we used delta-oriented programming, a recently proposed flexible approach for implementing software product lines, and developed: (i) delta-tables as a means to apply the delta-oriented programming idea to the specification of software product lines; and (ii) DeltaFineFit as a novel model-based testing approach for software product lines.

show abstract

An algorithm for generating t-wise covering arrays from large feature models

Cited by 191 publications

References 18 publications

Combinatorial Interaction Testing of Software Product Lines: A Mapping Study

Combinatorial Interaction Testing of Software Product Lines: A Mapping Study

A Technique for Agile and Automatic Interaction Testing for Product Lines

A novel model-based testing approach for software product lines

Contact Info

Product

Resources

About