Data-driven decision support under concept drift in streamed big data

Real-time water quality monitoring is a complex system as it involves many quality parameters to be monitored, the nature of these parameters, and non-linear interdependence between themselves. Intelligent algorithms crucial in building intelligent systems are good candidates for building a reliable and convenient monitoring system. To analyze water quality, we need to understand, model, and monitor the water pollution in real time using different online water quality sensors through an Internet of things framework. However, many water quality parameters cannot be easily measured online due to several reasons such as high-cost sensors, low sampling rate, multiple processing stages by few heterogeneous sensors, the requirement of frequent cleaning and calibration, and spatial and application dependency among different water bodies. A soft sensor is an efficient and convenient alternative approach for water quality monitoring. In this paper, we propose a machine learning-based soft sensor model to estimate biological oxygen demand (BOD), a time-consuming and challenging process to measure. We also propose a system architecture for implementing the soft sensor both on the cloud and edge layers, so that the edge device can make adaptive decisions in real time by monitoring the quality of water. A comparative study between the computational performance of edge and cloud nodes in terms of prediction accuracy, learning time, and decision time for different machine learning (ML) algorithms is also presented. This paper establishes that BOD soft sensors are efficient, less costly, and reasonably accurate with an example of a real-life application. Here, the IBK ML technique proves to be the most efficient in predicting BOD. The experimental setup uses 100 test readings of STP water samples to evaluate the performance of the IBK technique, and the statistical measures are reported as correlation coefficient = 0.9273, MAE = 0.082, RMSE = 0.1994, RAE = 17.20%, RRSE = 37.62%, and edge response time = 0.15 s only.

Section: Related Workmentioning

confidence: 99%

Machine learning based soft sensor model for BOD estimation using intelligence at edge

Pattnaik

Pattanayak

Udgata

et al. 2021

“…Although recommender systems have achieved great success in the past, the complex and dynamic characteristics that are a feature of big data are not handled well in these systems [200]. Traditional recommender systems assume that user preference is relatively static over a period of time, so users' history records are weighted equally.…”

Section: Concept Drift Detection and Reaction In Recommender Systemsmentioning

confidence: 99%

Artificial intelligence in recommender systems

Zhang

Jin

2020

Self Cite

237

Recommender systems provide personalized service support to users by learning their previous behaviors and predicting their current preferences for particular products. Artificial intelligence (AI), particularly computational intelligence and machine learning methods and algorithms, has been naturally applied in the development of recommender systems to improve prediction accuracy and solve data sparsity and cold start problems. This position paper systematically discusses the basic methodologies and prevailing techniques in recommender systems and how AI can effectively improve the technological development and application of recommender systems. The paper not only reviews cutting-edge theoretical and practical contributions, but also identifies current research issues and indicates new research directions. It carefully surveys various issues related to recommender systems that use AI, and also reviews the improvements made to these systems through the use of such AI approaches as fuzzy techniques, transfer learning, genetic algorithms, evolutionary algorithms, neural networks and deep learning, and active learning. The observations in this paper will directly support researchers and professionals to better understand current developments and new directions in the field of recommender systems using AI.

“…A large number of experiments on academic crisis warning have been conducted from the qualitative and quantitative perspectives. Data-driven machine learning methods have achieved satisfactory generalization performance [18]. However, there are still many obstacles in the popularization of universities.…”

Section: Related Workmentioning

confidence: 99%

An interpretable prediction method for university student academic crisis warning

Zhai

Wang

et al. 2021

Data-driven techniques improve the quality of talent training comprehensively for university by discovering potential academic problems and proposing solutions. We propose an interpretable prediction method for university student academic crisis warning, which consists of K-prototype-based student portrait construction and Catboost–SHAP-based academic achievement prediction. The academic crisis warning experiment is carried out on desensitization multi-source student data of a university. The experimental results show that the proposed method has significant advantages over common machine learning algorithms. In terms of achievement prediction, mean square error (MSE) reaches 24.976, mean absolute error (MAE) reaches 3.551, coefficient of determination ($$R^{2}$$ R 2 ) reaches 80.3%. The student portrait and Catboost–SHAP method are used for visual analysis of the academic achievement factors, which provide intuitive decision support and guidance assistance for education administrators.