Thorough statistical comparison of machine learning regression models and their ensembles for sub-pixel imperviousness and imperviousness change mapping

Abstract

Abstract:We evaluated the performance of nine machine learning regression algorithms and their ensembles for sub-pixel estimation of impervious areas coverages from Landsat imagery. The accuracy of imperviousness mapping in individual time points was assessed based on RMSE, MAE and R 2 . These measures were also used for the assessment of imperviousness change intensity estimations. The applicability for detection of relevant changes in impervious areas coverages at sub-pixel level was evaluated using overall accuracy, F-measure and ROC Area Under Curve. The results proved that Cubist algorithm may be advised for Landsat-based mapping of imperviousness for single dates. Stochastic gradient boosting of regression trees (GBM) may be also considered for this purpose. However, Random Forest algorithm is endorsed for both imperviousness change detection and mapping of its intensity. In all applications the heterogeneous model ensembles performed at least as well as the best individual models or better. They may be recommended for improving the quality of sub-pixel imperviousness and imperviousness change mapping. The study revealed also limitations of the investigated methodology for detection of subtle changes of imperviousness inside the pixel. None of the tested approaches was able to reliably classify changed and non-changed pixels if the relevant change threshold was set as one or three percent. Also for fi ve percent change threshold most of algorithms did not ensure that the accuracy of change map is higher than the accuracy of random classifi er. For the threshold of relevant change set as ten percent all approaches performed satisfactory.

Reliability Analysis of LandScan Gridded Population Data. The Case Study of Poland

“…The Polish settlement network is dispersed and comprises more than 56.6 thousand small villages or other rural settlement units like hamlets or lodges. Tree-covered, dispersed along agricultural lands, single homesteads are almost impossible to detect on satellite images [4,17,46]. Moreover, insufficiently illuminated small settlements do not give the blooming effect on the night-time lights satellite scenes [8,11], and consequently provide rather to underestimation than overestimation.…”

Sustainable finance: The role of savings and credit cooperatives in Ecuador

“…We measured the performance of the proposed models using several well‐known measures frequently used in evaluating the performance of credit firms: the classification accuracy rate (Acc) and the area under the receiver operating characteristic curve (AUC—the maximum accuracy would be associated with an AUC value closer to 1 and the minimum with a value of 0.5). We analyzed the performance of each class, using three performance metrics: accuracy (Acc), specificity (Sp) and sensitivity (Se) (Drzewiecki, 2017; Gu et al., 2009). These measures can be obtained from the confusion matrix, in which the diagonal represents the correctly classified examples and the off‐diagonal represents the classification errors.…”

A Survey of Machine Learning for Information Processing and Networking

“…As a result of the use of distributed approaches, which reduces communication and complexity between sensors, there is less power and less accuracy from these sensors.When an intrusion occurs, the integrity and confidentiality of the sensor network are put at risk. Imperviousness algorithms for complexity resolution were inspired by biological immunity systems, according to the authors of [10]. Sensor node data is first processed using an immune algorithm, and then SVM is used to detect intrusions.…”