Automatic generation of configurable test-suites for software product lines

Fragal, Vanderson Hafemann

doi:10.11606/t.55.2019.tde-10012019-085746

Cited by 2 publications

(9 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Analyzing (e.g., validating, verifying, and testing) and maintaining SPLs on a productbased basis is demanding due to the number of valid configurations (THÜM et al, 2014a). Hence, substantial effort has been spent on extending notations and associated reasoning techniques to SPLs (GRULER; LEUCKER; SCHEIDEMANN, 2008;CLASSEN et al, 2013;MOUSAVI, 2014;FRAGAL;MOUSAVI, 2017). These have led to family-based techniques relying on unified representations of all valid products known as family model (THÜM et al, 2014a) or 150% model (BEUCHE; SCHULZE; DUVIGNEAU, 2016).…”

Section: Motivationmentioning

confidence: 99%

“…Analyzing software product lines (SPL) on a product-based basis is very demanding and cumbersome, due to the number of possible products (THÜM et al, 2014a), crosscutting features (SCHAEFER et al, 2012), and the need to cater for possible feature interactions (APEL et al, 2013). Hence, family-based approaches have been developed to facilitate the analysis of SPLs without going individually through each and every product (BENDUHN et al, 2015;CLASSEN et al, 2013;MOUSAVI, 2014;FRAGAL;MOUSAVI, 2017). Such familybased approaches pave the way for efficient model-based analysis of SPL and typically involve a variability-aware behavioral specification referred to as a family model (THÜM et al, 2014a) or 150% model (BEUCHE; SCHULZE; DUVIGNEAU, 2016).…”

Section: Chapter 4 Family Model Learning For Product Linesmentioning

confidence: 99%

“…Model-based techniques designed explicitly to family models have enabled efficient test case generation (ATLEE et al, 2015;FRAGAL;MOUSAVI, 2017) and model checking (SABOURI; KHOSRAVI, 2013; TER BEEK; DE VINK; WILLEMSE, 2017). Nevertheless, the creation and maintenance of test models are known to be difficult, time consuming and error-prone (UTTING; PRETSCHNER; LEGEARD, 2012).…”

Section: Chapter 4 Family Model Learning For Product Linesmentioning

confidence: 99%

“…Our algorithm extends a technique for analyzing the effectiveness of automata learning algorithms (WALKINSHAW; BOGDANOV, 2013) to the domain of product lines by incorporating variability to indicate product-specific behaviors as feature constraints. Hence, we compare product FSMs to map feature constraints to their states and transitions, and merge them into a featured finite state machine (FFSM) (FRAGAL;MOUSAVI, 2017;FRAGAL et al, 2018). An FFSM is a family-based formalism for unifying Mealy Machines (BROY et al, 2005;GILL, 1962) specifying valid products of an SPL into a single representation by annotating states and transitions with feature constraints (FRAGAL et al, 2018).…”

Section: Chapter 4 Family Model Learning For Product Linesmentioning

confidence: 99%

“…To evaluate our approach, we have used an extensive benchmark of abstract representation of SPLs (CLASSEN, 2010;SAMIH et al, 2014;FRAGAL;MOUSAVI, 2017). First, we have evaluated the succinctness of the learned family models concerning the size of individual product models and hand-crafted specifications.…”

Section: Chapter 4 Family Model Learning For Product Linesmentioning

confidence: 99%

See 4 more Smart Citations

Learning finite state machine models of evolving systems: From evolution over time to variability in space

Damasceno¹

View full text Add to dashboard Cite

Maintenance and evolution have been accepted as integral principles in the software development life-cycle. They are essential for any system that operates in or addresses problems or activities of the real world if it is to remain useful and profitable. Nevertheless, as time passes and modifications occur, modeling artifacts are often neglected due to the lack of proper maintenance. Hence, it may render outdated models and hinder the application of model-based reasoning techniques, such as model-based testing and model checking. To address these issues, recent academic and industrial studies have shown that finite state machine (FSM) model learning techniques are becoming increasingly popular in software verification and testing. Despite these advances, model learning algorithms are still hampered by scalability issues, as well as the constant changes over time that may require learning from scratch. Furthermore, there is a lack of investigations about learning strategies for software product lines (SPL), i.e., systems where variants shall co-exist to satisfying the needs of distinct market segments and, hence, incorporate variability in space. In this PhD Thesis, we improve upon the state-of-the-art of model-based software engineering by introducing theoretical and experimental contributions to address model learning in the setting of evolving systems that incorporate modifications over time and variability in space. Our main contributions are threefold: (i) We have introduced the partial-Dynamic L * M , an adaptive algorithm that explores models from pre-existing versions onthe-fly to discard redundant and deprecated knowledge in terms of input sequences that may not lead to state discovery. Using realistic models of the OpenSSL toolkit, we have shown that our algorithm has been more efficient than state-of-the-art techniques and less sensitive to software evolution. (ii) We have filled the gap of model learning algorithms for variability-intensive systems by introducing the FFSM Diff algorithm. It is an automated technique to identify similar behavior shared among product-specific FSMs, annotate states, and transitions with feature constraints, and integrate them into succinct featured finite state machines (FFSM). Using 105 FSMs derived from six SPLs of academic benchmarks, we have shown that our algorithm can effectively merge families of state machines into succinct FFSMs, especially if there is high feature reuse among products. (iii) We have extended our expertise upon the FFSM Diff algorithm and reported our experiences on learning FFSMs through product sampling. Our results have indicated that FFSMs learned by sampling can be as precise as those learned from exhaustive analysis and hence, collectively cover the behavior of an SPL.

show abstract

Section: Motivationmentioning

confidence: 99%

Section: Chapter 4 Family Model Learning For Product Linesmentioning

confidence: 99%

Section: Chapter 4 Family Model Learning For Product Linesmentioning

confidence: 99%

Section: Chapter 4 Family Model Learning For Product Linesmentioning

confidence: 99%

Section: Chapter 4 Family Model Learning For Product Linesmentioning

confidence: 99%

See 3 more Smart Citations

Learning finite state machine models of evolving systems: From evolution over time to variability in space

Damasceno¹

View full text Add to dashboard Cite

show abstract

Learning by sampling: learning behavioral family models from software product lines

2021

View full text Add to dashboard Cite

Family-based behavioral analysis operates on a single specification artifact, referred to as family model, annotated with feature constraints to express behavioral variability in terms of conditional states and transitions. Family-based behavioral modeling paves the way for efficient model-based analysis of software product lines. Family-based behavioral model learning incorporates feature model analysis and model learning principles to efficiently unify product models into a family model and integrate the behavior of various products into a behavioral family model. Albeit reasonably effective, the exhaustive analysis of product lines is often infeasible due to the potentially exponential number of valid configurations. In this paper, we first present a family-based behavioral model learning techniques, called FFSM Diff . Subsequently, we report on our experience on learning family models by employing product sampling. Using 105 products of six product lines expressed in terms of Mealy machines, we evaluate the precision of family models learned from products selected from different settings of the T-wise product sampling criterion. We show that product sampling can lead to models as precise as those learned by exhaustive analysis and hence, reduce the costs for family model learning.

show abstract

Automatic generation of configurable test-suites for software product lines

Cited by 2 publications

References 45 publications

Learning finite state machine models of evolving systems: From evolution over time to variability in space

Learning finite state machine models of evolving systems: From evolution over time to variability in space

Learning by sampling: learning behavioral family models from software product lines

Contact Info

Product

Resources

About