Color-Based Point Cloud Classification Using a Novel Gaussian Mixed Modeling-Based Approach versus a Deep Neural Network

Abstract

The classification of point clouds is an important research topic due to the increasing speed, accuracy, and detail of their acquisition. Classification using only color is basically absent in the literature; the few available papers provide only algorithms with limited usefulness (transformation of three-dimensional color information to a one-dimensional one, such as intensity or vegetation indices). Here, we proposed two methods for classifying point clouds in RGB space (without using spatial information) and evaluated the classification success since it allows a computationally undemanding classification potentially applicable to a wide range of scenes. The first is based on Gaussian mixture modeling, modified to exploit specific properties of the RGB space (a finite number of integer combinations, with these combinations repeated in the same class) to automatically determine the number of spatial normal distributions needed to describe a class (mGMM). The other method is based on a deep neural network (DNN), for which different configurations (number of hidden layers and number of neurons in the layers) and different numbers of training subsets were tested. Real measured data from three sites with different numbers of classified classes and different “complexity” of classification in terms of color distinctiveness were used for testing. Classification success rates averaged 99.0% (accuracy) and 96.2% (balanced accuracy) for the mGMM method and averaged 97.3% and 96.7% (balanced accuracy) for the DNN method in terms of the best parameter combinations identified.

A Mobile Image Aesthetics Processing System with Intelligent Scene Perception

“…Image aesthetic processing (IAP) algorithms correct and enhance image content based on composition, contrast, color saturation, and brightness settings. Some extant models perform model training and prediction on the cloud [5][6][7]; however, it is difficult to deploy them on mobile devices, resulting in poor performance in terms of energy consumption and latency [8]. Other studies do not consider scene category information [9,10], which implies different aesthetic processing standards.…”