Testing the robustness of controllers for self-adaptive systems

Cámara, Javier; Lemos, Rogério de; Laranjeiro, Nuno; Ventura, Rafael; Vieira, Marco

doi:10.1186/1678-4804-20-1

Cited by 22 publications

(10 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…TESTING OF ASS AND CASS: APPROACHES AND CHALLENGES Cámara et al [31] performed an evaluation study using Znn.com by focusing on the Controllercomponent (i.e. the managing system).…”

Section: Of 46mentioning

confidence: 99%

Testing of adaptive and context‐aware systems: approaches and challenges

Siqueira

Ferrari

Souza

et al. 2021

Software Testing Verif & Rel

View full text Add to dashboard Cite

Adaptive systems (ASs) and context-aware systems (CASs) are able to evaluate their own behaviour and to adapt it when the system fails to accomplish its goals or when better functionality or performance is possible. Ensuring the reliability of ASs and CASs is demanding because failures might have undesirable consequences. Testing ASs and CASs effectively is not trivial because of the inherent characteristics of these systems. The literature lacks a comprehensive review that provides a broad picture of the area; current reviews are outdated and incomplete. The objectives of this study are characterizing the state of the art in AS and CAS testing and discussing approaches, challenges, observed trends, and research limitations and directions. We performed a systematic literature review (SLR) and a thematic analysis of studies, reporting up-to-date, refined and extended results when compared with existing reviews. Based on 102 selected studies, we (i) characterized testing approaches by grouping techniques for ASs and CASs; (ii) updated and refined a characterization of testing challenges for ASs and CASs; and (iii) analysed and discussed research trends and implications for AS and CAS testing. There are recurring research concerns regarding AS and CAS testing. Examples are the generation of test cases and built-in tests. Moreover, we also identified recurring testing challenges such as context monitoring and runtime decisions. Moreover, there are some trends such as model-based testing and hybrid techniques and some little investigated issues like uncertainty and prediction of changes. All in all, our results may provide guidance for developers and researchers with respect to the practice and the future research on AS and CAS testing.

show abstract

“…TESTING OF ASS AND CASS: APPROACHES AND CHALLENGES Cámara et al [31] performed an evaluation study using Znn.com by focusing on the Controllercomponent (i.e. the managing system).…”

Section: Of 46mentioning

confidence: 99%

Testing of adaptive and context‐aware systems: approaches and challenges

Siqueira

Ferrari

Souza

et al. 2021

Software Testing Verif & Rel

View full text Add to dashboard Cite

show abstract

“…Testing of SASS has been addressed by others as well. This related work could usually be assigned to one of the following categories: 1) The adaptation is formally specified and verified with special constructs regarding the adaptation [21,22], 2) the SASS is tested/verified at runtime/online and the verification expressions are adapted to properties unique to adaptation [10]- [12], 3) tests are evolved at runtime in an attempt to test for requirement fulfillment even when the environment or the adaptable software changes [13,14], and 4) testing is carried out at design time addressing the special issues of adaptive systems [15]- [17]. 5) Combined assessment of quality assurance for self-adaptive systems from more than one direction has also been done [23].…”

Section: Related Workmentioning

confidence: 99%

“…Some approaches address the testing of SASS but only for later development stages [10]- [14] when the systems have already been deployed. Others do promote testing in earlier stages but they still assume an executable and complete SASS to run the tests against [15]- [17]. Testing of only parts of the feedback loop is not supported.…”

Section: Introductionmentioning

confidence: 99%

A Testing Scheme for Self-Adaptive Software Systems with Architectural Runtime Models

Hänsel

Vogel

Giese

2015

2015 IEEE International Conference on Self-Adaptive and Self-Organizing Systems Workshops

View full text Add to dashboard Cite

Self-adaptive software systems (SASS) are equipped with feedback loops to adapt autonomously to changes of the software or environment. In established fields, such as embedded software, sophisticated approaches have been developed to systematically study feedback loops early during the development. In order to cover the particularities of feedback, techniques like one-way and in-the-loop simulation and testing have been included. However, a related approach to systematically test SASS is currently lacking. In this paper we therefore propose a systematic testing scheme for SASS that allows engineers to test the feedback loops early in the development by exploiting architectural runtime models. These models that are available early in the development are commonly used by the activities of a feedback loop at runtime and they provide a suitable high-level abstraction to describe test inputs as well as expected test results. We further outline our ideas with some initial evaluation results by means of a small case study. c 2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

show abstract

“…When consensus exists, the same evaluation metrics could be related to multi-defect types. In addition, the majority of existing work proposes to manually define the detection rules [88,57,26]. This task is complex, time-consuming and subjective.…”

Section: Introductionmentioning

confidence: 99%

Assessing the quality of mobile graphical user interfaces using multi-objective optimization

et al. 2019

View full text Add to dashboard Cite

Aesthetic defects are a violation of quality attributes that are symptoms of bad interface design programming decisions. They lead to deteriorating the perceived usability of mobile user interfaces and negatively impact the Users eXperience (UX) with the mobile app. Most existing studies relied on a subjective evaluation of aesthetic defects depending on end-users feedback, which makes the manual evaluation of mobile user interfaces human-centric, time-consuming, and error-prone. Therefore, recent studies have dedicated their effort to focus on the definition of mathematical formulas that each targets a specific structural quality of the interface. As the UX is tightly dependent on the user profile, the combination and calibration of quality attributes, formulas, and users characteristics, when defining a defect, is not straightforward. In this context, we propose a fully automated framework which combines literature quality attributes with the users profile to identify aesthetic defects of MUI. More precisely, we consider the mobile user interface evaluation as a multi-objective optimization problem where the goal is to maximize the number of detected violations while minimizing the detection complexity of detection rules and enhancing the interfaces overall quality in means

show abstract

Testing the robustness of controllers for self-adaptive systems

Cited by 22 publications

References 18 publications

Testing of adaptive and context‐aware systems: approaches and challenges

Testing of adaptive and context‐aware systems: approaches and challenges

A Testing Scheme for Self-Adaptive Software Systems with Architectural Runtime Models

Assessing the quality of mobile graphical user interfaces using multi-objective optimization

Contact Info

Product

Resources

About