As a key technology in wireless networks, signal recognition is widely used in various military and civilian fields. By correctly recognizing the modulation scheme of the received unknown signal, the performance of the communication system can be improved. With the comprehensive digitization and intelligence of the world, the rapid development of wireless communication puts forward higher requirements for signal recognition: 1) Accurate and efficient recognition of various modulation modes and 2) Lightweight recognition of intelligent hardware. Therefore, through in-depth study of hybrid model and lightweight modulation recognition, this paper first designs a hybrid signal recognition model based on convolutional neural network and gating recursive unit (CnGr). By combining the spatial module with the temporal module, the multi-dimensional extraction of the original signal is promoted and the recognition accuracy is effectively improved. Further, a lightweight signal recognition method is given by combining pruning and depthwise separable convolution. The network can be reduced effectively on the premise of ensuring the recognition accuracy, which facilitates the deployment and implementation on edge devices. Extensive experiments demonstrate that the proposed method can effectively improve the recognition accuracy, and reduce the model significantly without reducing the accuracy.