Testing acoustic scene classifiers using Metamorphic Relations

Organizations employ data mining to discover patterns in historic data in order to learn predictive models. Depending on the predictive model the predictions may be more or less accurate, raising the question about the reliability of individual predictions. This paper proposes a reference process aligned with the CRISP-DM to enable the assessment of reliability of individual predictions obtained from a predictive model. The reference process describes activities along the different stages of the development process required to establish a reliability assessment approach for a predictive model. The paper then presents in more detail two specific approaches for reliability assessment: perturbation of input cases and local quality measures. Furthermore, this paper describes elements of a knowledge graph to capture important metadata about the development process and training data. The knowledge graph serves to properly configure and employ the reliability assessment approaches.

show abstract

An Approach For Verifying And Validating Clustering Based Anomaly Detection Systems Using Metamorphic Testing

Rehman

Izurieta

2022

2022 IEEE International Conference on Artificial Intelligence Testing (AITest)

View full text Add to dashboard Cite

Testing acoustic scene classifiers using Metamorphic Relations

Cited by 6 publications

References 15 publications

Conducting Design Science Research in Society 5.0 – Proposal of an Explainable Artificial Intelligence Research Methodology

Conducting Design Science Research in Society 5.0 – Proposal of an Explainable Artificial Intelligence Research Methodology

A Reference Process for Assessing the Reliability of Predictive Analytics Results

An Approach For Verifying And Validating Clustering Based Anomaly Detection Systems Using Metamorphic Testing

Contact Info

Product

Resources

About