Multilayer perceptron architecture optimization using parallel computing techniques

Abstract

The objective of this research was to develop a methodology for optimizing multilayer-perceptron-type neural networks by evaluating the effects of three neural architecture parameters, namely, number of hidden layers (HL), neurons per hidden layer (NHL), and activation function type (AF), on the sum of squares error (SSE). The data for the study were obtained from quality parameters (physicochemical and microbiological) of milk samples. Architectures or combinations were organized in groups (G1, G2, and G3) generated upon interspersing one, two, and three layers. Within each group, the networks had three neurons in the input layer, six neurons in the output layer, three to twenty-seven NHL, and three AF (tan-sig, log-sig, and linear) types. The number of architectures was determined using three factorial-type experimental designs, which reached 63, 2 187, and 50 049 combinations for G1, G2 and G3, respectively. Using MATLAB 2015a, a logical sequence was designed and implemented for constructing, training, and evaluating multilayer-perceptron-type neural networks using parallel computing techniques. The results show that HL and NHL have a statistically relevant effect on SSE, and from two hidden layers, AF also has a significant effect; thus, both AF and NHL can be evaluated to determine the optimal combination per group. Moreover, in the three study groups, it is observed that there is an inverse relationship between the number of processors and the total optimization time.

Determination of the superficial citral content on microparticles: An application of NIR spectroscopy coupled with chemometric tools

“…ANN s have been widely used for prediction (multilayer perceptron - MLP ) and classification (radial basis neuronal networks - RBN ). An artificial neuron can calculate the weighted sum of its inputs and then apply an activation function to obtain a signal that is transmitted to the next neuron [33], [34].…”

Novel computational deep learning strategy for neuroprotection identification reveals unique set of nicotine analogs as potential therapeutic compounds against Parkinson’s disease

“…Based on the architecture of PI3K/AKT represented by the MCMC transition matrix, the multilayer perceptron ANN model was constructed. The topology for the multi-perceptron ANN was particular given that typical architectures for these models tend to reduce the number of nodes per layer across the model (57). We hypothesize that resulting architecture of the model can be associated with the biological topology of the SP and MCMC; nevertheless, additional analysis should be performed.…”

Flood Hazard Mapping Using the Flood and Flash-Flood Potential Index in the Buzău River Catchment, Romania

“…where Od is the output decision, ωj and ω0 represent the connection weights, and h is the hidden layer. The hidden layers are also connected to the output layers through a neural connection which holds the output weights [33,[71][72][73][74][75]. Initially, the weights of the connections hold random values until they intersect another connection-a phase in which they are multiplied by the associated weights and that intersection [34].…”