Automated Discovery of Failure Domain

Abstract

Abstract-There are several automated random strategies of software testing based on the presence of point, block and strip failure domains inside the whole input domain. As yet no particular, fully automated test strategy has been developed for the discovery and evaluation of the failure domains. We therefore have developed Automated Discovery of Failure Domain (ADFD), a new random test strategy that finds the failures and their domains in a given system under test. It further provides visualization of the identified pass and fail domains. In this paper we describe ADFD strategy, its implementation in York Extensible Testing Infrastructure (YETI) and illustrate its working with the help of an example. We report on experiments in which we tested error-seeded one and two-dimensional numerical programs. Our experimental results show that for each program, ADFD strategy successfully performs identification of failures, failure domains and their representation on graphical chart.

ADFD+: An Automatic Testing Technique for Finding and Presenting Failure Domains

“…The paper highlights the improved features of ADFD+ in comparison with ADFD technique previously developed by our team [4]. The paper then analyses and compares the experimental results of ADFD+ and Randoop for the point, block and strip failure domains.…”

“…The external parameters were kept constant in each test. Due to the absence of contracts and assertions in the code under test, undeclared exceptions were taken as failures in accordance with the previous studies [4], [9].…”

“…Testing of several error-seeded one and two-dimensional numerical programs was carried out as per program code [4]. The programs were divided in to set A and B containing one and two-dimensional programs respectively.…”

“…Randoop Fig. 3 shows that the failure domain forms a block pattern and the boundaries of the failure are (5, 2), (5, 3), (5, 4), (6, 2), (6, 4), (7, 2), (7, 4), (8,2), (8,3), (8,4). the y − axis represent average time taken by the tools to detect the failure domains.…”

“…To target failures and evaluate the failure domains we developed earlier ADFD technique [4]. The ADFD+, an improved version of ADFD, is a fully automatic technique which finds failures and failure domains within a specified radius and presents the results on a graphical chart.…”