Metamorphic Model-Based Testing Applied on NASA DAT -- An Experience Report

Lindvall, Mikael; Ganesan, Dharmalingam; Ardal, Ragnar; Wiegand, Robert E.

doi:10.1109/icse.2015.348

Cited by 50 publications

(45 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Aruna and Prasad [129] presented a small case study on the application of metamorphic testing to two popular graph theory algorithms. Finally, Lindvall et al [130] presented an experience report on the use of metamorphic testing to address acceptance testing of NASA's Data Access Toolkit (DAT). DAT is a huge database of telemetry data collected from different NASA missions, and an advance query interface to search and mine the available data.…”

Section: Other Domainsmentioning

confidence: 99%

A Survey on Metamorphic Testing

Segura

Fraser

Sánchez

et al. 2016

IIEEE Trans. Software Eng.

430

230

View full text Add to dashboard Cite

Abstract-A test oracle determines whether a test execution reveals a fault, often by comparing the observed program output to the expected output. This is not always practical, for example when a program's input-output relation is complex and difficult to capture formally. Metamorphic testing provides an alternative, where correctness is not determined by checking an individual concrete output, but by applying a transformation to a test input and observing how the program output "morphs" into a different one as a result. Since the introduction of such metamorphic relations in 1998, many contributions on metamorphic testing have been made, and the technique has seen successful applications in a variety of domains, ranging from web services to computer graphics. This article provides a comprehensive survey on metamorphic testing: It summarises the research results and application areas, and analyses common practice in empirical studies of metamorphic testing as well as the main open challenges.

show abstract

Section: Other Domainsmentioning

confidence: 99%

A Survey on Metamorphic Testing

Segura

Fraser

Sánchez

et al. 2016

IIEEE Trans. Software Eng.

430

230

View full text Add to dashboard Cite

show abstract

“…Model-based testing (MBT) is one such technique (Apfelbaum and Doyle 1997;Dustin et al 1999;Boberg et al 2008;Utting et al 2012). MBT has been successfully applied in different application domains Lindvall et al 2015). Each application domain introduces specific challenges and opportunities for the utilization of MBT.…”

Section: Introductionmentioning

confidence: 99%

Model-based testing of digital TVs: an industry-as-laboratory approach

Sözer

Gebizli

2016

Software Qual J

View full text Add to dashboard Cite

Model-based testing is a promising approach for increasing the efficiency of the testing process and for improving software quality. It has been employed in the industry for more than a decade. Nevertheless, there are still challenges regarding its application in different domains. Some of these challenges are general, while some others are domainspecific. In this paper, we explain our experiences in enhancing model-based testing for its adoption in the consumer electronics domain, in particular for Digital TV systems. We applied the so-called industry-as-laboratory approach to define/refine research problems and evaluate our research results. We summarize these results and provide an evaluation of relevant research problems for our context. We observed that the industry-as-laboratory approach is highly effective for industry-academia collaboration and technology transfer in the scope of model-based software testing.

show abstract

“…A growing body of research and industrial application has investigated the concept of metamorphic testing (MT) [5], [6], [7], [8], [9], [10], [11], [12], [13], [14], and has proven MT to be a highly effective testing paradigm for the detection of real-life software faults in the absence of an ideal test oracle. The idea of MT is simple: Instead of focusing on the correctness of each individual output, MT looks at the relationships among the inputs and outputs of multiple executions of the SUT.…”

Section: Introductionmentioning

confidence: 99%

Metamorphic Testing of Navigation Software: A Pilot Study with Google Maps

Brown¹,

Zhi²,

Chow³

2018

Proceedings of the Annual Hawaii International Conference on System Sciences

View full text Add to dashboard Cite

Abstract-Millions of people use navigation software every day to commute and travel. In addition, many systems rely upon the correctness of navigation software to function, ranging from directions applications to self-driving machinery. Navigation software is difficult to test because it is hard or very expensive to evaluate its output. This difficulty is generally known as the oracle problem, a fundamental challenge in software testing. In this study, we propose a metamorphic testing strategy to alleviate the oracle problem in testing navigation software, and conduct a case study by testing the Google Maps mobile app, its web service API, and its graphical user interface. The results show that our strategy is effective with the detection of several real-life bugs in Google Maps. This study is the first work on automated testing of navigation software with the detection of real-life bugs.

show abstract

Metamorphic Model-Based Testing Applied on NASA DAT -- An Experience Report

Cited by 50 publications

References 9 publications

A Survey on Metamorphic Testing

A Survey on Metamorphic Testing

Model-based testing of digital TVs: an industry-as-laboratory approach

Metamorphic Testing of Navigation Software: A Pilot Study with Google Maps

Contact Info

Product

Resources

About