The effect of gamma value on support vector machine performance with different kernels

Abstract

Currently, the support vector machine (SVM) regarded as one of supervised machine learning algorithm that provides analysis of data for classification and regression. This technique is implemented in many fields such as bioinformatics, face recognition, text and hypertext categorization, generalized predictive control and many other different areas. The performance of SVM is affected by some parameters, which are used in the training phase, and the settings of parameters can have a profound impact on the resulting engine’s implementation. This paper investigated the SVM performance based on value of gamma parameter with used kernels. It studied the impact of gamma value on (SVM) efficiency classifier using different kernels on various datasets descriptions. SVM classifier has been implemented by using Python. The kernel functions that have been investigated are polynomials, radial based function (RBF) and sigmoid. UC irvine machine learning repository is the source of all the used datasets. Generally, the results show uneven effect on the classification accuracy of three kernels on used datasets. The changing of the gamma value taking on consideration the used dataset influences polynomial and sigmoid kernels. While the performance of RBF kernel function is more stable with different values of gamma as its accuracy is slightly changed.

Building a Cardiovascular Disease Prediction Model for Smartwatch Users Using Machine Learning: Based on the Korea National Health and Nutrition Examination Survey

“…The results showed the same classification performance (Accuracy 83.04%) as without normalization. Further analysis in the next step seeks to compare performance while varying the penalty parameter C, kernel parameter Gamma, and kernel function, which are parameters that affect the performance of support vector machine [35]. In this paper, we select the optimal pair (C, Gamma) from C = {1(default),10,100} and Gamma = {0.01, 0.1, 1/number of input variables(default)}.…”

Komparasi Fungsi Kernel Metode Support Vector Machine untuk Analisis Sentimen Instagram dan Twitter (Studi Kasus : Komisi Pemberantasan Korupsi)

“…Pada kernel polinomial terdapat penggunaan derajat yang dapat diatur untuk meningkatkan kemungkinan data dapat dipisahkan secara linier dalam ruang berdimensi tinggi, tanpa memperlambat waktu model [13]. Pada kernel sigmoid penggunaan gamma dapat diatur untuk meningkatkan nilai akurasi akan tetapi bergantung pada jumlah fitur yang digunakan [14].…”

“…3. Kernel sigmoid [20] Menurut [14] penggunaan gamma yang terlalu tinggi pada kernel sigmoid cenderung menurunkan tingkat akurasi pada suatu klasifikasi tetapi tetap bergantung pada jumlah fitur yang digunakan, semakin banyak jumah fitur maka gamma yang digunakan cenderung kecil, dan sebaliknya.…”

Intrusion Detection System for NSL-KDD Dataset Based on Deep Learning and Recursive Feature Elimination

“…Many of the common methods are used to detect intrusion in intrusion detection systems, such as Support vector machines [7,8], K-nearest neighbor (KNN) [9], and Random forest (RF) [10]. [11] Suggested IDS on the NSL-KDD dataset by using the support vector machine and decision tree algorithms [12], respectively. Use anomaly detection with the Naive Bayes (NB) [13] and examined on the KDD99 [14].…”