A Novel Framework Using Deep Auto-Encoders Based Linear Model for Data Classification

Abstract

This paper proposes a novel data classification framework, combining sparse auto-encoders (SAEs) and a post-processing system consisting of a linear system model relying on Particle Swarm Optimization (PSO) algorithm. All the sensitive and high-level features are extracted by using the first auto-encoder which is wired to the second auto-encoder, followed by a Softmax function layer to classify the extracted features obtained from the second layer. The two auto-encoders and the Softmax classifier are stacked in order to be trained in a supervised approach using the well-known backpropagation algorithm to enhance the performance of the neural network. Afterwards, the linear model transforms the calculated output of the deep stacked sparse auto-encoder to a value close to the anticipated output. This simple transformation increases the overall data classification performance of the stacked sparse auto-encoder architecture. The PSO algorithm allows the estimation of the parameters of the linear model in a metaheuristic policy. The proposed framework is validated by using three public datasets, which present promising results when compared with the current literature. Furthermore, the framework can be applied to any data classification problem by considering minor updates such as altering some parameters including input features, hidden neurons and output classes.

Machine Learning–Based Early Fire Detection System Using a Low-Cost Drone

“…These are total accuracy, positive interpretation power, negative interpretation power, sensitivity, F-rating and specificity. When calculating these values, DP: true-positive, DN: true-negative, YP: falsepositive and YN: false-negative FN: false-negative is used [16][17][18]. The true-positive expression refers to the number of operations in the sample space where the work carried out in the dissertation project, in which the model also contains smoke for visual data that actually contains smoke.…”

VGG16 Feature Extractor with Extreme Gradient Boost Classifier for Pancreas Cancer Prediction

“…The most often utilised attributes for recognising targets are texture and colour moment, which are both global features. In [68], an SVM classifier produced SE = 93 and SP = 92 after they retrieved colour, texture, and form variables. To perform well on a dataset of 217 melanomas and 588 photos, [69,70] used colour moment characteristics and texture features.…”

A vehicle images occlusion removal recognition method based on contextual self-encoder

“…Self-encoder networks consist of input, hidden, and output layers, which are not essentially different from neural networks [10] . The contextual self-encoder is an improvement based on the self-encoder, which combines contextual information consistency and image structure unity, providing an advantage in repairing occluded regions [11] .…”