Support Vector Machines for Unbalanced Multicategory Classification

Abstract

Classification is a very important research topic and its applications are various, because data can be easily obtained in these days. Among many techniques of classification the support vector machine (SVM) is widely applied to bioinformatics or genetic analysis, because it gives sound theoretical background and its performance is superior to other methods. The SVM can be rewritten by a combination of the hinge loss function and the penalty function. The smoothly clipped absolute deviation penalty function satisfies desirably statistical properties. Since standard SVM techniques typically treat all classes equally, it is not well suited to unbalanced proportion data. We propose a robust method to treat unbalanced cases based on the weights of the class. Simulation and a numerical example show that the proposed method is effective to analyze unbalanced proportion data.

Radar recognition system based on XG-Boost

“…A larger value of γ indicates a preference for obtaining trees with simpler structures, implying a higher penalty for trees with a greater number of leaf nodes. Similarly, a larger value of λ also signifies a preference for simpler tree structures [7] .…”

Genetic algorithm–optimized support vector machine for real-time activity recognition in health smart home

“…Obviously, the distribution of different categories is not uniform, so a robust SVM method which treats unbalanced cases based on the weights of classes is employed. 40…”