2020
DOI: 10.1109/tse.2018.2876433
|View full text |Cite
|
Sign up to set email alerts
|

Metamorphic Relations for Enhancing System Understanding and Use

Abstract: Modern information technology paradigms, such as online services and off-the-shelf products, often involve a wide variety of users with different or even conflicting objectives. Every software output may satisfy some users, but may also fail to satisfy others. Furthermore, users often do not know the internal working mechanisms of the systems. This situation is quite different from bespoke software, where developers and users usually know each other. This paper proposes an approach to help users to better unde… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
3
2

Citation Types

0
63
0

Year Published

2022
2022
2024
2024

Publication Types

Select...
5
3

Relationship

3
5

Authors

Journals

citations
Cited by 91 publications
(63 citation statements)
references
References 75 publications
(108 reference statements)
0
63
0
Order By: Relevance
“…An increasing body of research has investigated the concept of MT for a variety of application domains [5], [12]. MT has been applied not only for conventional software testing but also for other purposes such as cybersecurity enhancement [13], [14] and system understanding [15]. In recent years, there has been a growing trend towards applying MT to test intelligent (especially machine learning) and autonomous systems [16], [17], [18], [19].…”
Section: Metamorphic Testingmentioning
confidence: 99%
“…An increasing body of research has investigated the concept of MT for a variety of application domains [5], [12]. MT has been applied not only for conventional software testing but also for other purposes such as cybersecurity enhancement [13], [14] and system understanding [15]. In recent years, there has been a growing trend towards applying MT to test intelligent (especially machine learning) and autonomous systems [16], [17], [18], [19].…”
Section: Metamorphic Testingmentioning
confidence: 99%
“…All the above studies on abstract forms of MRs, when introduced, were limited to their specific application domains (that is, search functions [15], [16] and RESTful web APIs [17]). More recently, Zhou et al [14] further investigated the notion of "patterns" and formally defined the general concept of a metamorphic relation pattern (MRP) as "an abstraction that characterizes a set of (possibly infinitely many) metamorphic relations." Zhou et al also defined a concept of a metamorphic relation input pattern (MRIP) as "an abstraction that characterizes the relations among the source and follow-up inputs of a set of (possibly infinitely many) metamorphic relations."…”
Section: Metamorphic Relation Patternmentioning
confidence: 99%
“…To facilitate systematic identification of useful MRs, a concept of metamorphic relation "patterns" has been pro-posed from which multiple concrete metamorphic relations can be derived [13], [14]. Zhou et al [14] defined a metamorphic relation pattern (MRP) as an abstraction that characterizes a set of (possibly infinitely many) metamorphic relations, and they also identified a universal MRP, symmetry. In the present research, we propose a noise MRP, which is a sub-pattern under symmetry, and show its applications using real-life software systems in different domains.…”
Section: Introductionmentioning
confidence: 99%
“…Although their work was for classification in supervised ML, we were inspired to apply their idea and approach to unsupervised ML. In keeping with recent work related to metamorphic exploration [17], because we do not assume that the MRs identified in this process have been rigorously evaluated and confirmed to strictly be MRs [14], in this instance we refer to them as hypothesized metamorphic relations (HMRs). By making reference to Xie et al [21] and Jarman et al [22], we list the following HMRs for the K-means clustering algorithm: • HMR7: In 2D, flipping the data points along one (x-or y-) axis should not have an impact on the clustering results.…”
Section: Metamorphic Relationsmentioning
confidence: 99%
“…MT has been used by both professional software developers and end-user programmers [15], and has been developed into a framework covering verification, validation, and other types of software quality assessment [16], with MRs not only defined by developers, but also by the users. More recently, MRs have been applied to enhance system understanding and use [17], where MRs need not be necessary properties for software correctness, but can instead be properties hypothesized by the users, who can use such MRs to explore the software system, enhancing their understanding of the system, and hence using it in a better way. This approach is called metamorphic exploration.…”
Section: Introductionmentioning
confidence: 99%