A Cost-driven Approach for Metamorphic Testing

Chen, Jing; Kuo, Fei-Ching; Xie, Xue‐Jun; Wang, Lu

doi:10.4304/jsw.9.9.2267-2275

Cited by 2 publications

(4 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We concluded in our previous work [43] that MT is a cost-effective approach for factual applications with mathematical functions. In this paper, we propose an approach to construct MRs between event sequences, which can construct multiple types of metamorphic relations to test various business processes of actual applications.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

A metamorphic testing approach for event sequences

et al. 2019

Self Cite

View full text Add to dashboard Cite

Test oracles are commonly used in software testing to determine the correctness of the execution results of test cases. However, the testing of many software systems faces the test oracle problem: a test oracle may not always be available, or it may be available but too expensive to apply. One such software system is a system involving abundant business processes. This paper focuses on the testing of business-process-based software systems and proposes a metamorphic testing approach for event sequences, called MTES , to alleviate the oracle problem. We utilized event sequences to represent business processes and then applied the technique of metamorphic testing to test the system without using test oracles. To apply metamorphic testing, we studied the general rules for identifying metamorphic relations for business processes and further demonstrated specific metamorphic relations for individual case studies. Three case studies were conducted to evaluate the effectiveness of our approach. The experimental results show that our approach is feasible and effective in testing the applications with rich business processes. In addition, this paper summarizes the experimental findings and proposes guidelines for selecting good metamorphic relations for business processes.

show abstract

Section: Discussionmentioning

confidence: 99%

“…The threat to external validity is mainly related to the systems under test. In this paper, the system under test in case study 2 was used in our previous study [43]. The system in case study 1 is similar to that in case study 2.…”

Section: Discussionmentioning

confidence: 99%

A metamorphic testing approach for event sequences

et al. 2019

Self Cite

View full text Add to dashboard Cite

show abstract

“…For example, one could use the same test cases for different MRs (Chen et al 2014c (Wu 2005). Combination relations is another possible method.…”

Section: Efficiency Of Metamorphic Testingmentioning

confidence: 99%

“…There is a time cost associated with test case generation and execution (Chen et al 2014c). As discussed in Section 4.1.1, different MRs have different MTG sizes.…”

Section: Efficiency Of Metamorphic Testingmentioning

confidence: 99%

A mapping study on testing non-testable systems

Patel

Hierons

2017

Software Qual J

View full text Add to dashboard Cite

The terms "Oracle Problem" and "Non-testable system" interchangeably refer to programs in which the application of test oracles is infeasible. Test oracles are an integral part of conventional testing techniques; thus, such techniques are inoperable in these programs. The prevalence of the oracle problem has inspired the research community to develop several automated testing techniques that can detect functional software faults in such programs. These techniques include N-Version testing, Metamorphic Testing, Assertions, Machine Learning Oracles, and Statistical Hypothesis Testing. This paper presents a Mapping Study that covers these techniques. The Mapping Study presents a series of discussions about each technique, from different perspectives, e.g. effectiveness, efficiency, and usability. It also presents a comparative analysis of these techniques in terms of these perspectives. Finally, potential research opportunities within the non-testable systems problem domain are highlighted within the Mapping Study. We believe that the aforementioned discussions and comparative analysis will be invaluable for new researchers that are attempting to familiarise themselves with the field, and be a useful resource for practitioners that are in the process of selecting an appropriate technique for their context, or deciding how to apply their selected technique. We also believe that our own insights, which are embedded throughout these discussions and the comparative analysis, will be useful for researchers that are already accustomed to the field. It is our hope that the potential research opportunities that have been highlighted by the Mapping Study will steer the direction of future research endeavours.

show abstract

A Cost-driven Approach for Metamorphic Testing

Cited by 2 publications

References 26 publications

A metamorphic testing approach for event sequences

A metamorphic testing approach for event sequences

A mapping study on testing non-testable systems

Contact Info

Product

Resources

About