AI Total: Analyzing Security ML Models with Imperfect Data in Production

Abstract

The landing page of the dashboard, showing the Filter panel to the left, and the Visualization panel with three tabs on the right, with the Model Metrics tab selected. The first two charts are Detection (True Positive) Rates and False Positive Rates of our selected models and other anonymized detection engines for detecting malicious portable executable (PE) files. Then we show the Ratio of Samples scanned per engines, followed by TPR, FPR and the finally the ROC curve.