Using Big Data-machine learning models for diabetes prediction and flight delays analytics

Abstract

Introduction Nowadays large data volumes are daily generated at a high rate. Data from health system, social network, financial, government, marketing, bank transactions as well as the censors and smart devices are increasing. The tools and models have to be optimized. In this paper we applied and compared Machine Learning algorithms (Linear Regression, Naïve bayes, Decision Tree) to predict diabetes. Further more, we performed analytics on flight delays. The main contribution of this paper is to give an overview of Big Data tools and machine learning models. We highlight some metrics that allow us to choose a more accurate model. We predict diabetes disease using three machine learning models and then compared their performance. Further more we analyzed flight delay and produced a dashboard which can help managers of flight companies to have a 360° view of their flights and take strategic decisions. Case description We applied three Machine Learning algorithms for predicting diabetes and we compared the performance to see what model give the best results. We performed analytics on flights datasets to help decision making and predict flight delays. Discussion and evaluation The experiment shows that the Linear Regression, Naive Bayesian and Decision Tree give the same accuracy (0.766) but Decision Tree outperforms the two other models with the greatest score (1) and the smallest error (0). For the flight delays analytics, the model could show for example the airport that recorded the most flight delays. Conclusions Several tools and machine learning models to deal with big data analytics have been discussed in this paper. We concluded that for the same datasets, we have to carefully choose the model to use in prediction. In our future works, we will test different models in other fields (climate, banking, insurance.).

A mini-review of machine learning in big data analytics: Applications, challenges, and prospects

“…It was observed that 58% of the reviewed papers [15, were based on BD predictive analytics, 18% BD prescriptive analytics [103][104][105] , 11% BD descriptive analytics [15, , whiles 9% (A+B) [100][101][102][103][104][105] and 5% (B+C) [106][107][108] . Few studies in BDA used prescriptive analytics (see Table A1 in Appendix); this can be attributed to fact that big data prescriptive analytics is in its early stage.…”

“…ML algorithm's hybridisation is an excellent technique to compensate for the weakness in the individual algorithm [9] . However, it was revealed that few studies out of 66 papers reviewed adopted it [70,83,85,88,101,102,107,108,118,122] . From Fig.…”

An intelligent diabetes classification and perception framework based on ensemble and deep learning method

“…The experimental results show that SVM achieved the highest accuracy, which is 77.73%. Nibareke & Laassiri (2020) compared DT, LR, and NB classifiers on Vincent Sigillitan’s data set. This work aims to overview machine learning modeling and big data tools.…”

Navigating the Ethical and Privacy Concerns of Big Data and Machine Learning in Decision Making

“…Opperhuizen and Schouten [81] 2021 Media √ √ Issue attention analysis Liu et al [73] 2021 Environmental monitoring √ √ Mapping Sharma and Gupta [82] 2021 Healthcare √ √ Predictive analysis Kovacs-Györi et al [83] 2020 Urban planning √ √ Geospatial analysis Nibareke and Laassiri [84] 2020 Healthcare, aviation √ √ Prediction Hosseini et al [65] 2020 Healthcare √ √ Medication optimization…”