A Distributed Storage and Computation k-Nearest Neighbor Algorithm Based Cloud-Edge Computing for Cyber-Physical-Social Systems

Abstract

The k-nearest neighbor (kNN) algorithm is a classic supervised machine learning algorithm. It is widely used in cyber-physical-social systems (CPSS) to analyze and mine data. However, in practical CPSS applications, the standard linear kNN algorithm struggles to efficiently process massive data sets. This paper proposes a distributed storage and computation k-nearest neighbor (D-kNN) algorithm. The D-kNN algorithm has the following advantages: First, the concept of k-nearest neighbor boundaries is proposed and the k-nearest neighbor search within the k-nearest neighbors boundaries can effectively reduce the time complexity of kNN. Second, based on the k-neighbor boundary, massive data sets beyond the main storage space are stored on distributed storage nodes. Third, the algorithm performs k-nearest neighbor searching efficiently by performing distributed calculations at each storage node. Finally, a series of experiments were performed to verify the effectiveness of the D-kNN algorithm. The experimental results show that the D-kNN algorithm based on distributed storage and calculation effectively improves the operation efficiency of k-nearest neighbor search. The algorithm can be easily and flexibly deployed in a cloud-edge computing environment to process massive data sets in CPSS. INDEX TERMS kNN, k-nearest neighbor boundary, distributed storage and computation, cloud-edge computing, CPSS.

Predictive Supervised Machine Learning Models for Diabetes Mellitus

“…In both tasks, the input features consists of K closest training examples or the dataset in the feature space, while the algorithm relies on labeled data for the learning process to produce appropriate outputs for unlabeled input features. The idea behind the KNN algorithm is that if a sample has k most similar neighbors in the feature space, m13ost of the samples belong to a certain category, then the sample also belongs to this category [ 4 , 30 , 31 ]. The voting method is generally used in the classification task, that is, the category label that appears frequently in the k sample is selected as the prediction result, while in the case of the regression task, the average method is used where the real value output labels of the k sample are used as the prediction result [ 5 , 31 ].…”

Pengembangan Sistem Analisis Sentimen Berbasis Java Pada Data Twitter Terhadap Omnibus Law Menggunakan Algoritma Naïve Bayes dan K-Nearst Neighbor (K-NN)

“…Ada juga yang berpendapat bahwa algoritma KNN adalah algoritma pembelajaran yang banyak digunakan dalam sistem cyber-fisiksosial (CPSS) untuk menganalisis dan menambang data (main data). (Zhang, Chen, Liu, & Xi, 2020).…”

Modeling cooperative behavior for resilience in cyber-physical systems using SDN and NFV

“…Data-driven proactive management will be essentially supported by ML/AI techniques. These techniques, once deployed in future networked systems, should offer a new range of networking-based services such as smart routing in networks with a cross-layer design [59], task offloading and resource allocation [60], optimized operation of next-generation mobile networks [61], distributed storage and computation at the network edge [62], and accurate localization estimation of mobile robots [63]. In parallel with this expected network evolution, novel challenges such as privacy, e.g.…”