2020
DOI: 10.14778/3415478.3415488
|View full text |Cite
|
Sign up to set email alerts
|

Ease.ml/snoopy in action

Abstract: We demonstrate ease.ml/snoopy, a data analytics system that performs feasibility analysis for machine learning (ML) applications before they are developed. Given a performance target of an ML application (e.g., accuracy above 0.95), ease.ml/snoopy provides a decisive answer to ML developers regarding whether the target is achievable or not. We formulate the feasibility analysis problem as an instance of Bayes error estimation. That is, for a data (distribution) o… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

0
9
0

Year Published

2023
2023
2023
2023

Publication Types

Select...
6

Relationship

0
6

Authors

Journals

citations
Cited by 8 publications
(10 citation statements)
references
References 16 publications
0
9
0
Order By: Relevance
“…Speci cally, we use Cherubin's codebase [9] to experiment with the Tamaraw and CS-BuFLO defenses, as well as the WFES estimator; Gong et al 's repository [26] to experiment with the FRONT and WTF-PAD defenses; and Rahman et al 's re-implementation of WeFDE [62]. We also implemented the kNN-based BER estimator proposed by Renggli et al [66].…”
Section: Methodsmentioning
confidence: 99%
See 2 more Smart Citations
“…Speci cally, we use Cherubin's codebase [9] to experiment with the Tamaraw and CS-BuFLO defenses, as well as the WFES estimator; Gong et al 's repository [26] to experiment with the FRONT and WTF-PAD defenses; and Rahman et al 's re-implementation of WeFDE [62]. We also implemented the kNN-based BER estimator proposed by Renggli et al [66].…”
Section: Methodsmentioning
confidence: 99%
“…DeepSE-WF (this work) Learned DL BER & MI using nite datasets is an extensively researched problem in the eld of machine learning [5,13,17,21,22,60,66,72]. Inspired by Cover and Hart [13], Cherubin reduces the WF problem to a classi cation task and leverages the error of the Nearest Neighbor classi er as a proxy to estimate the lower bound for the error of any potential classi er used on prede ned features.…”
Section: Estimator Features Metricmentioning
confidence: 99%
See 1 more Smart Citation
“…The serving can be provided, e.g., via a REST API. As a foundational infrastructure layer, a scalable and distributed model serving infrastructure is recommended [23], [27], [33], [37], [39], [46] Additionally, monitoring of the ML infrastructure, CI/CD, and orchestration are required [7], [23], [24], [28], [32], [33], [50]…”
Section: C3 Workflow Orchestration Component (P2 P3 P6)mentioning
confidence: 99%
“…, 2022; Mäkinen et al. , 2021; Renggli et al. , 2021) and organizational research on AI/ML use and management (Berente et al.…”
Section: Introductionmentioning
confidence: 99%