Outlier detection for power data based on contractive auto-encoder

Yuan, Lu; Leng, Xiaojie; Xu, Kang; Luan, Weiping; Yang, Wei; Li, Jing

doi:10.1145/3373477.3373500

Cited by 3 publications

(1 citation statement)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the case of outlier and noisy data being indiscernible in datasets, several studies illustrated that by eliminating noisy and outlier data at the preprocessing step, the predictive models' performance is improved [32][33][34]. Xia (2019) [35] proposed integration between outlier removal and gradientboosting algorithm for credit scoring on peer-to-peer lending datasets.…”

Section: A Traditional Credit Scoring Modelsmentioning

confidence: 99%

A Novel Method for Credit Scoring Based on Cost-Sensitive Neural Network Ensemble

2021

View full text Add to dashboard Cite

Most existing studies on credit scoring adapted a concept of classifier ensemble for solving an imbalanced dataset. They apply resampling methods to generate multiple training subsets for constructing multiple base classifiers. However, this approach leads to several problems that degrade the classification performance, such as problems of information loss, model overfitting, and computational cost. Thus, we propose a novel ensemble approach for developing a credit scoring model based on a cost-sensitive neural network, called Cost-sensitive Neural Network Ensemble (CS-NNE). In the proposed approach, multiple class weights are adapted to original training data, enabling the multiple base neural networks to consider imbalanced classes. Following this approach, a high diversity of multiple base classifiers without consequent problems can be achieved. The approach's effectiveness is evaluated on five real-world credit datasets. Among them is a loan-requesting dataset provided by a financial institution in Thailand. The remaining datasets are publicly available and widely used by several existing studies. The experimental results showed that the proposed CS-NNE approach improves the predictive performance over a single neural network based on imbalanced credit datasets, e.g., Thai credit dataset, by achieving 1.36%, 15.67%, and 6.11% Area under the ROC Curve (AUC), Default Detection Rate (DDR), and G-Mean (GM), respectively, and achieving the best Misclassification Cost (MC). The proposed CS-NNE approach can effectively solve a class of imbalance problems and outperform many existing models. The prediction model can well compromise between classes of default (bad credit applicants) and non-default (good credit applicants), whereas existing approaches preferred a class of non-default over default loans (having high specificity and low DDR), resulting in NPL.

show abstract