An Ecosystem Approach for Testing Self-Organizing, Adaptive Systems

Markov, Georgi; Fröhlich, Joachim Hans

doi:10.1109/sasow.2015.24

Cited by 1 publication

(1 citation statement)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…• Usage of formal specification and fault model (6-c): Markov and Fröhlich [116] coined the term 'test ecosystem' to refer to an approach that combines roles, formal methods and tools of different sources and suppliers. In short, the authors presented a platform that provides an endto-end testing environment that the developer can instantiate and customize with respect to business goals, intended uses, interfaces and so forth.…”

Section: • Analysis Of Context Diversity (5-d) and Test Selection (5-f)mentioning

confidence: 99%

Testing of adaptive and context‐aware systems: approaches and challenges

Siqueira

Ferrari

Souza

et al. 2021

Software Testing Verif & Rel

View full text Add to dashboard Cite

Adaptive systems (ASs) and context-aware systems (CASs) are able to evaluate their own behaviour and to adapt it when the system fails to accomplish its goals or when better functionality or performance is possible. Ensuring the reliability of ASs and CASs is demanding because failures might have undesirable consequences. Testing ASs and CASs effectively is not trivial because of the inherent characteristics of these systems. The literature lacks a comprehensive review that provides a broad picture of the area; current reviews are outdated and incomplete. The objectives of this study are characterizing the state of the art in AS and CAS testing and discussing approaches, challenges, observed trends, and research limitations and directions. We performed a systematic literature review (SLR) and a thematic analysis of studies, reporting up-to-date, refined and extended results when compared with existing reviews. Based on 102 selected studies, we (i) characterized testing approaches by grouping techniques for ASs and CASs; (ii) updated and refined a characterization of testing challenges for ASs and CASs; and (iii) analysed and discussed research trends and implications for AS and CAS testing. There are recurring research concerns regarding AS and CAS testing. Examples are the generation of test cases and built-in tests. Moreover, we also identified recurring testing challenges such as context monitoring and runtime decisions. Moreover, there are some trends such as model-based testing and hybrid techniques and some little investigated issues like uncertainty and prediction of changes. All in all, our results may provide guidance for developers and researchers with respect to the practice and the future research on AS and CAS testing.

show abstract

Section: • Analysis Of Context Diversity (5-d) and Test Selection (5-f)mentioning

confidence: 99%