Application of metamorphic testing monitored by test adequacy in a Monte Carlo simulation program

Ding, Junhua; Hu, Xinhua

doi:10.1007/s11219-016-9337-3

Cited by 8 publications

(3 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Due to the unknown test output relations, the MRs of this program are considered weak and inadequate. Ding and Hu [16] developed a method for the adequacy of MRs. Coverage criterion, mutation analysis, and mutation tests for testing MRs are critical factors in evaluating the adequacy of MRs. An image processing program that is used to reconstruct a 3D biological cell is used to explain the author's proposed theory. A case study is performed using a complex Monte Carlo program to gauge the effectiveness of this proposed framework.…”

Section: Related Workmentioning

confidence: 99%

“…The mutation score indicates the fault detection rate of each MR. In the existing literature, i.e., [12,14,16,19], all the MRs are evaluated by seeding faults manually in the code or through a tool that calculates the mutation score automatically through the traditional mutation testing approach. We have seeded the faults manually and checked the relation manually on both the programs (original and mutated) for the calculation of the mutation score.…”

Section: Mr Evaluation Using Mutation Testingmentioning

confidence: 99%

“…Afterward, mutation testing is performed to evaluate MRs. Mutation operators always play an important role in generating the mutants. In existing literature [12,14,16,17], only a few mutation operators are used that have generated a very small number of mutants. The authors did not discuss the effectiveness of mutation operators or which operator is effective enough to generate and kill a maximum number of mutants.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Measuring Effectiveness of Metamorphic Relations for Image Processing Using Mutation Testing

Jafari,

Nadeem

2024

J. Imaging

View full text Add to dashboard Cite

Testing an intricate plexus of advanced software system architecture is quite challenging due to the absence of test oracle. Metamorphic testing is a popular technique to alleviate the test oracle problem. The effectiveness of metamorphic testing is dependent on metamorphic relations (MRs). MRs represent the essential properties of the system under test and are evaluated by their fault detection rates. The existing techniques for the evaluation of MRs are not comprehensive, as very few mutation operators are used to generate very few mutants. In this research, we have proposed six new MRs for dilation and erosion operations. The fault detection rate of six newly proposed MRs is determined using mutation testing. We have used eight applicable mutation operators and determined their effectiveness. By using these applicable operators, we have ensured that all the possible numbers of mutants are generated, which shows that all the faults in the system under test are fully identified. Results of the evaluation of four MRs for edge detection show an improvement in all the respective MRs, especially in MR1 and MR4, with a fault detection rate of 76.54% and 69.13%, respectively, which is 32% and 24% higher than the existing technique. The fault detection rate of MR2 and MR3 is also improved by 1%. Similarly, results of dilation and erosion show that out of 8 MRs, the fault detection rates of four MRs are higher than the existing technique. In the proposed technique, MR1 is improved by 39%, MR4 is improved by 0.5%, MR6 is improved by 17%, and MR8 is improved by 29%. We have also compared the results of our proposed MRs with the existing MRs of dilation and erosion operations. Results show that the proposed MRs complement the existing MRs effectively as the new MRs can find those faults that are not identified by the existing MRs.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Mr Evaluation Using Mutation Testingmentioning

confidence: 99%