Adaptive CNN Ensemble for Complex Multispectral Image Analysis

Abstract

Multispectral image classification has long been the domain of static learning with nonstationary input data assumption. The prevalence of Industrial Revolution 4.0 has led to the emergence to perform real-time analysis (classification) in an online learning scenario. Due to the complexities (spatial, spectral, dynamic data sources, and temporal inconsistencies) in online and time-series multispectral image analysis, there is a high occurrence probability in variations of spectral bands from an input stream, which deteriorates the classification performance (in terms of accuracy) or makes them ineffective. To highlight this critical issue, firstly, this study formulates the problem of new spectral band arrival as virtual concept drift. Secondly, an adaptive convolutional neural network (CNN) ensemble framework is proposed and evaluated for a new spectral band adaptation. The adaptive CNN ensemble framework consists of five (05) modules, including dynamic ensemble classifier (DEC) module. DEC uses the weighted voting ensemble approach using multiple optimized CNN instances. DEC module can increase dynamically after new spectral band arrival. The proposed ensemble approach in the DEC module (individual spectral band handling by the individual classifier of the ensemble) contributes the diversity to the ensemble system in the simple yet effective manner. The results have shown the effectiveness and proven the diversity of the proposed framework to adapt the new spectral band during online image classification. Moreover, the extensive training dataset, proper regularization, optimized hyperparameters (model and training), and more appropriate CNN architecture significantly contributed to retaining the performance accuracy.

An Adaptive Federated Machine Learning-Based Intelligent System for Skin Disease Detection: A Step toward an Intelligent Dermoscopy Device

“…Remarkably, the proposed approach (ensemble approach) contributes to diversity in a simple yet effective manner. This study also used the single-instance optimized CNN model inspired by [34,35] (which was carefully devised after numerous experiments) as an instance in the cloud server's ensemble. Furthermore, the authors trained the proposed model using a challenging dataset (the ISIC 2019 dataset).…”

Deterioration of Electrical Load Forecasting Models in a Smart Grid Environment

“…Among the literature survey, Jameel S. et al [49][50][51] proposed multiple adaptive frameworks in their studies. They presented an adaptive framework for different ML and DL applications that included complex and multispectral image analysis, image classification following the digital transformation of IoT and IR 4.0, and disease identification in skins to detect it at an early stage.…”

Real-Time Implementation of AI-Based Face Mask Detection and Social Distancing Measuring System for COVID-19 Prevention

“…A typical convolution operation, shown in Figure 3, denotes the input image by X (n H , n W , and n C ), where n H , n W , and n C are the height, the width size of the feature map, and the number of channels, respectively, while K(f, f, n C ) is the filter kernel, where f × f is the size of the convolution 8 Scientific Programming kernel. us, the CONV formula is denoted in equation ( 3), and the output dimension is given by equation (4), where s designates the stride parameter [27,28]:…”