Majority filter-based minority prediction (MFMP): An approach for unbalanced datasets

Abstract

For many data mining and machine learning applications predicting minority class samples from skewed unbalanced data sets is a crucial problem. To address this problem, we propose a majority filter-based minority prediction (MFMP) approach for unbalanced datasets. The MFMP adopts an unsupervised learning technique for selecting samples for supervised learning. The approach is based on two steps. In the first-step, minority samples are clustered and majority class samples that are out of minority classification regions are identified. This improves minority prediction rate. In the second step majority samples are randomly selected in individual clusters and this enhances majority prediction rate. Experimentally we studied the behavior of MFMP approach and compared with the traditional random under-sampling approach on a synthetic data set and three UCI repository datasets using the following classifiers: decision tree, k-nearest neighbor, Naive Bayes and Radial basis function network. Precision, Recall and F-Measure are used for evaluating performance of classifiers. The experimental evidence suggests that MFMP approach exhibits good prediction rates over minority and majority classes on all classifiers. Furthermore, the proposed approach outperforms the traditional random under-sampling approach. MFMP applied on the decision tree gave better prediction as compared to other classifiers studied.

A Wide Scale Classification of Class Imbalance Problem and its Solutions: A Systematic Literature Review

“…Li et al (2015b) uses meta heuristic optimization algorithms (such as Bat Algorithm (BA) and Particle Swarm Optimization algorithm (PSO)) to optimize the selection for improving the performance of classifiers for imbalanced data. Padmaja et al (2008) proposed a new method for fraud detection, that uses extreme outlier elimination using k-Reverse NN (kRNN) approach.…”

Object-based image analysis approach for vessel detection on optical and radar images

“…Thus the choice of retaining a Gaussian clutter modeling is coupled with ad hoc image postprocessing, in order to properly remove false alarms (e.g., spurious points). A majority filter 42 coupled with the application of the morphological operators of dilation and erosion have been applied to the resulting binary images. Then OBIA has been applied to cluster and extract ship objects as described for optical data.…”

Análisis de las relaciones entre hábitos de vida, percepción del entorno y apoyo social, utilizando herramientas de Big Data

“…desarrolla dos sistemas de aprendizaje conjunto para superar la deficiencia de la pérdida de información introducida en el método de submuestreo Chawla, Bowyer, Hall & Kegelmeyer (2002). diseñaron un método (SMOTE) que combina el sobremuestreo de la clase minoritaria y el submuestreo de la clase mayoritaria en la búsqueda de un mejor clasificador Padmaja, Krishna & Bapi (2008). recomiendan el algoritmo de la predicción de las minorías basadas en el filtro de las mayorías (MFMP) basado en dos pasos: en el primero las minorías se agrupan y se identifican mejorando su tasa de predicción; en el segundo paso, la mayoría de las muestras se seleccionan aleatoriamente en grupos individuales Japkowicz (2000).…”