Using the Aggregated Criteria to Evaluate the Software Tests Quality

Abstract

An approach to evaluating the software tests quality using aggregated quality criteria is proposed. The article considers the finding of such characteristics of software tests that can be used to judge their quality and their need for improvement. The subject of the study is the formation of a software tests quality evaluation system, which can be used in the software development process. It is proposed to consider a software test as a multiattribute object. It is emphasized that it is necessary to take into account both quantitative and qualitative characteristics of tests and test coverage, which greatly complicates the construction of a model for evaluating the software tests quality. Various approaches to solving the problem of evaluating complex, multiattribute objects are considered. The problem of comparing and ordering complex objects taking into account different criteria is considered. The choice of the method of sequential aggregation of classified states to solve the problem of multi-criteria selection and assessment is justified. The stages of the procedure for solving the estimation problem using the method of sequential aggregation of classified states are considered. An activity diagram is constructed that reflects an algorithm for constructing a hierarchical system of criteria. The criteria for evaluating software tests are given, which belong to three groups-efficiency, coverage, and software implementation. For a hierarchical system of criteria aggregation, a set of indicators, their qualitative gradations with corresponding numerical intervals, are allocated. At the highest level of the hierarchy, it is proposed to use three composite criteria that correspond to the groups of efficiency, coverage and implementation, which will allow to obtain an integral indicator of the software tests quality. The resulting integral indicator includes five quality classes, each of which corresponds to a multitude of low-level indicator estimates. Tests quality evaluation will improve the testing process, which purpose is to ensure the specified quality of the software being developed.

Information solutions for evaluating the quality of software tests

“…A schematic general model of the testing process is presented in Figure 2. To assess the quality of tests, it is proposed to use aggregated criteria, this approach was considered in [6].…”