2009
DOI: 10.1155/2009/868215
|View full text |Cite
|
Sign up to set email alerts
|

Cumulative Gains Model Quality Metric

Abstract: This paper proposes a more comprehensive look at the ideas of KS and Area Under the Curve AUC of a cumulative gains chart to develop a model quality statistic which can be used agnostically to evaluate the quality of a wide range of models in a standardized fashion. It can be either used holistically on the entire range of the model or at a given decision threshold of the model. Further it can be extended into the model learning process.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

0
6
0

Year Published

2014
2014
2024
2024

Publication Types

Select...
5
1

Relationship

0
6

Authors

Journals

citations
Cited by 7 publications
(6 citation statements)
references
References 1 publication
0
6
0
Order By: Relevance
“…The description of the obtained network is presented in table 2. Brandenburger and Furth (2009). Gains chart is a graphical presentation of the usefulness of the model for predicting the value of dependent categorical variable assuming two values.…”
Section: Resultsmentioning
confidence: 99%
“…The description of the obtained network is presented in table 2. Brandenburger and Furth (2009). Gains chart is a graphical presentation of the usefulness of the model for predicting the value of dependent categorical variable assuming two values.…”
Section: Resultsmentioning
confidence: 99%
“…In data mining community, several statistical methods are used to assess the performance of a given model such as the Kolmogorov-Smirnov (K-S) statistics [192,193], decile analysis [171,194,195], lift charts [171,172], and cumulative gains chart [173,190,193]. These methods aim at identifying the model that generates the highest gain with the least cost [171].…”
Section: Model Performance Evalution Methodsmentioning
confidence: 99%
“…These methods aim at identifying the model that generates the highest gain with the least cost [171]. In general, they follow two approaches: evaluating more than one competing model at the same time, or assessing one model only by including cost evaluation metrics in the data mining process [193,196].…”
Section: Model Performance Evalution Methodsmentioning
confidence: 99%
“…Visual indicators mainly include ROC curve [43] and AUC [44], precision-recall curve (also known as PR curve) [45], gain curve [46], K-S curve and K-S statistical value [47], and lift curve [48] and lift value.…”
Section: Visual Indicatorsmentioning
confidence: 99%