This study proposes an efficient rolling bearing fault diagnosis model of a hybrid neural network with a lightweight attention mechanism. Firstly, to achieve the low complexity of deep learning computation, data reduction and denoising are performed by sparse convolutional network (Principal Component Analysis and Improved Complete Ensemble Empirical Modal Decomposition of Adaptive Noise), then processed data is imported to the hybrid neural network model with CBAM (Convolutional Block Attention Module ). The BiLSTM-SCN (Bi-directional Long Short-Term Memory and Sparse Convolutional Networks ) are used in the backbone of the model. A lightweight, generalized attention mechanism is introduced to the last layer of the model for enhancing feature learning, which can further improve the diagnostic accuracy and efficiency. Compared with existing deep learning fault diagnosis models, In simulating the most realistic cross-conditions and cross-platform conditions, which leads to the random nature of fault generation and makes model diagnosis more complex, the proposed method still maintains less running time and excellent diagnostic accuracy. Finally, the experimental results fully prove that the model has reliable robust and efficient, and it achieves the best balance of diagnostic accuracy and diagnostic efficiency of the hybrid deep learning model.