Application of Machine Learning Algorithms for the Validation of a New CoAP-IoT Anomaly Detection Dataset

Abstract

With the rise in smart devices, the Internet of Things (IoT) has been established as one of the preferred emerging platforms to fulfil their need for simple interconnections. The use of specific protocols such as constrained application protocol (CoAP) has demonstrated improvements in the performance of the networks. However, power-, bandwidth-, and memory-constrained sensing devices constitute a weakness in the security of the system. One way to mitigate these security problems is through anomaly-based intrusion detection systems, which aim to estimate the behaviour of the systems based on their “normal” nature. Thus, to develop anomaly-based intrusion detection systems, it is necessary to have a suitable dataset that allows for their analysis. Due to the lack of a public dataset in the CoAP-IoT environment, this work aims to present a complete and labelled CoAP-IoT anomaly detection dataset (CIDAD) based on real-world traffic, with a sufficient trace size and diverse anomalous scenarios. The modelled data were implemented in a virtual sensor environment, including three types of anomalies in the CoAP data. The validation of the dataset was carried out using five shallow machine learning techniques: logistic regression, naive Bayes, random forest, AdaBoost, and support vector machine. Detailed analyses of the dataset, data conditioning, feature engineering, and hyperparameter tuning are presented. The evaluation metrics used in the performance comparison are accuracy, precision, recall, F1 score, and kappa score. The system achieved 99.9% accuracy for decision tree models. Random forest established itself as the best model, obtaining a 99.9% precision and F1 score, 100% recall, and a Cohen’s kappa statistic of 0.99.

A novel and effective method based deep learning model for detecting non-technical electricity losses

“…The application of machine learning classifiers and deep learning algorithms on a dataset of hourly, daily, or monthly consumption records is one such commonly used method for NTL identification. These save time and money in the detection of probable anomalies [24]- [26].…”

Machine Learning and Deep Learning Techniques for Internet of Things Network Anomaly Detection—Current Research Trends

“…Introducing a new dataset, the research in [ 59 ] focused on anomaly detection in IoT environments, addressing limitations of sensing devices’ power, bandwidth, and memory. It introduced a novel CoAP-IoT dataset for anomaly detection, validated these data using supervised learning techniques, and proposed an ML-based IDS that overcame previous solutions.…”

“…The ranged uses of RFs over the years makes it an accurate ML model for detecting anomalies and attacks. Most of the studies share a common drawback, which is the need for more varied datasets to validate the proposed models [ 59 , 64 , 71 ]. This is followed by the drawback that the models can be computationally heavy for IoT systems [ 69 ].…”

Digital twin-driven prognostics and health management for industrial assets

“…Apache Beam 78 handles stream and batch data efficiently. CoAP 79 supports fast response and real-time communication. External connection modeling between DTs In clustered manufacturing, the DTs of multiple production units share data by connections to optimize resource utilization and reduce fault analysis costs during operation and maintenance.…”

“…Apache Beam 78 handles stream and batch data efficiently. CoAP 79 supports fast response and real-time communication.…”