An Automated and Distributed Machine Learning Framework for Telecommunications Risk Management

Abstract

Automation and scalability are currently two of the main challenges of Machine Learning (ML). This paper proposes an automated and distributed ML framework that automatically trains a supervised learning model and produces predictions independently of the dataset and with minimum human input. The framework was designed for the domain of telecommunications risk management, which often requires supervised learning models that need to be quickly updated by non-ML-experts and trained on vast amounts of data. Thus, the architecture assumes a distributed environment, in order to deal with big data, and Automated Machine Learning (AutoML), to select and tune the ML models. The framework includes several modules: task detection (to detect if classification or regression), data preprocessing, feature selection, model training and deployment. In this paper, we detail the model training module. In order to select the computational technologies to be used in this module, we first analyzed the capabilities of an initial set of five modern AutoML tools: Auto-Keras, Auto-Sklearn, Auto-Weka, H2O AutoML, and TransmogrifAI. Then, we performed a benchmarking of the only two tools that address a distributed ML (H2O AutoML and TransmogrifAI). Several comparison experiments were held using three real-world datasets from the telecommunications domain (churn, event forecasting, and fraud detection), allowing to measure the computational effort and predictive capability of the AutoML tools. d

An Automated Machine Learning Approach for Predicting Chemical Laboratory Material Consumption

“…Once a ML model is selected, the model was retrained with all training data. As in [8], the AutoML was configured to include a total of 6 distinct regression algorithms: RF, Extremely Randomized Trees (XRT), Generalized Linear Model (GLM), GBM, XGBoost (XG) and a Stacked Ensemble (SE). The RF is a popular ensemble method that combines a large number of decision trees based on bagging and random selection of input features [10].…”

“…In all these ML predictive studies, expert knowledge and trial-error experiments were used to select and tune the predictive ML algorithms, which is a common ML practice. However, there is a recent ML trend that assumes the usage of AutoML [8]. The main advantage of AutoML is that it alleviates the ML analyst effort, allowing to focus on other aspects of the ML pipeline process (e.g., data engineering).…”

“…The approach was developed using the CRoss-Industry Standard Process for Data Mining (CRISP-DM) methodology [26]. Similarly to the work conducted in [20], to better focus on feature engineering (data preparation phase of CRISP-DM), we adopt an Automated Machine Learning (AutoML) [8], which is executed during the modeling CRISP-DM phase and that allows to automatically select and tune the hyperparameters of the predictive ML models. Using real-word data, collected from a chemical company, we executed several CRISP-DM iterations, exploring three main input variable selection strategies and two sets of AL materials (top 10 and all consumed materials).…”

Predicting Physical Properties of Woven Fabrics via Automated Machine Learning and Textile Design and Finishing Features

“…The AutoML was configured to automatically select the regression model and its hyperparameters based on the best Mean Absolute Error (MAE), using a internal 5-fold cross-validation applied over the training data. We adopted the same AutoML configuration executed in [13]. The computational experiments were executed on a desktop computer and each ML algorithm was trained using a maximum running time of 3,600 s. After selecting the best ML algorithm, its best set of hyperparameters are fixed and the ML is retrained with all training data.…”

Chemical Laboratories 4.0: A Two-Stage Machine Learning System for Predicting the Arrival of Samples

“…All computational experiments were executed on the same personal computer and each individual ML model was trained up to a maximum running time of 3,600 s. Once a ML model is selected, the model was retrained with all training data. As in [11], the AutoML was configured to include a total of 6 distinct regression algorithms: RF, Extremely Randomized Trees (XRT), Generalized Linear Model (GLM), GBM, XGBoost (XG) and a Stacked Ensemble (SE). The RF is a popular ensemble method that combines a large number of decision trees based on bagging and random selection of input features [15].…”