Fostering interpretability of data mining models through data perturbation

Abstract

With the widespread adoption of data mining models to solve real-world problems, the scientific community is facing the need of increasing their interpretability and comprehensibility. This is especially relevant in the case of black box models, in which inputs and outputs are usually connected by highly complex and nonlinear functions; in applications requiring an interaction between the user and the model; and when the machine's solution disagrees with the human experience. In this contribution we present a new methodology that allows to simplify the process of understanding the rules behind a classification model, even in the case of black box ones. It is based on the perturbation of the features describing one instance, and on finding the minimal variation required to change the forecasted class. It thus yields simplified rules describing under which circumstances would the solution have been different, and allows to compare these with the human expectation. We show how such methodology is well defined, model-agnostic, easy to implement and modular; and demonstrate its usefulness with several synthetic and real-world data sets.

An Early Stage Researcher's Primer on Systems Medicine Terminology

“… 130 However, interpretability or explainability of the results of such approaches hinder their use in practice. 131 It should be noted that CDSSs still remain not as highly adopted by users, perhaps partially due to general lack of engagement from clinicians, physicians, or health specialists. 132 …”

Deep learning in systems medicine

“…One of the main criticisms against DL is a general lack of interpretability due to its black-box nature [21,160]. Nevertheless, progress has been made in improving the interpretability of DL in healthcare [115,161,162]. For example, by highlighting patient trajectories that maximally activate CNN predictions, Suresh et al [126] improved the interpretability when applying the CNN to predict clinical intervention…”