NS-k-NN: Neutrosophic Set-Based k-Nearest Neighbors Classifier

Abstract

k-nearest neighbors (k-NN), which is known to be a simple and efficient approach, is a non-parametric supervised classifier. It aims to determine the class label of an unknown sample by its k-nearest neighbors that are stored in a training set. The k-nearest neighbors are determined based on some distance functions. Although k-NN produces successful results, there have been some extensions for improving its precision. The neutrosophic set (NS) defines three memberships namely T, I and F. T, I, and F shows the truth membership degree, the false membership degree, and the indeterminacy membership degree, respectively. In this paper, the NS memberships are adopted to improve the classification performance of the k-NN classifier. A new straightforward k-NN approach is proposed based on NS theory. It calculates the NS memberships based on a supervised neutrosophic c-means (NCM) algorithm. A final belonging membership U is calculated from the NS triples as U = T + I − F. A similar final voting scheme as given in fuzzy k-NN is considered for class label determination. Extensive experiments are conducted to evaluate the proposed method's performance. To this end, several toy and real-world datasets are used. We further compare the proposed method with k-NN, fuzzy k-NN, and two weighted k-NN schemes. The results are encouraging and the improvement is obvious.

Machine Learning Approach to Dysphonia Detection

“…Akbulut et al [25] stated that the KNN method is considered to be one of the oldest and the simplest types of nonparametric classifier. A nonparametric model for KNN means that the classification of the test data does not use a function that has been set up in advance based on the learning process on the training dataset.…”

Investigating the Applications of Machine Learning Techniques to Predict the Rock Brittleness Index

“…The basic theory behind the KNN is discovering a group of "k" samples (e.g., employing the distance functions) which has the nearest distance from unknown samples in the calibration dataset. Moreover, the KNN identifies the class of unknown samples among the "k" samples by calculating the average of the response variables [45]. Thus, the "k" plays an important role in the KNN performance [46].…”

Supervised Machine Learning Techniques to the Prediction of Tunnel Boring Machine Penetration Rate

“…The KNN finds a group of k samples (e.g., using the distance functions) which are closest to unknown samples in the calibration dataset, constituting the basic theory of KNN. The KNN also determines the label (class) of unknown samples among the k samples through the calculation of the average of the response variables [61,62]. Consequently, k plays a significant role in the performance of the KNN [63].…”