Underground fire monitoring is an important tool to improve coal mine production safety. In this paper, a multi-source information identification method based on bilinear convolutional neural network (B-CNN) is proposed, which consists of construction of multi-source image acquisition system, B-CNN and integrated decision making based on multi-source B-CNN. Aiming at the problem that Softmax loss function based on the gradient descent in B-CNN is easy falling into the local optimum, an improved Grasshopper Optimization Algorithm (GOA) is proposed to optimally selected two parameters of W and θ; the method of initial solution generation based on sine mapping and the method of accepting bad solution with certain probability are respectively adopted. In order to solve high computational complexity in the stage of model training and integrated recognition by multi-source B-CNN, an image feature preprocessing method is proposed in this paper. Several feature vectors of color feature, shape feature and texture feature of the collected image are extracted and used as input vectors of B-CNN to complete model training and integrated recognition. In simulation experiments, firstly, four Benchmark functions are used to verify the performance of the improved GOA; then, by scaling, expanding and rotating the image to simulate the results of image acquisition at multiple positions and angles, different information sources can be formed to complete the integrated recognition by B-CNN. Three performance indexes of Accuracy, Precision and Recall are used to evaluate the simulation result of different comparative models, which show that the proposed method has better recognition effects.INDEX TERMS Bilinear convolutional neural network, coal mine, data modeling, feature extraction, image processing.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.