Among the basic components of cognitive radio technology is spectrum sensing technology. Cooperative spectrum sensing is also a crucial factor research directions of spectrum sensing. Due to the problems of channel fading and hidden nodes, the spectrum sensing based on a single node cannot meet the requirements of the cognitive radio system for the primary user (PU) detection performance. A spectrum sensing algorithm is based on CNN-SVM and covariance matrix. In this algorithm, the covariance matrix of the signal is input into the convolutional neural network for feature extraction. Secondly, the result of the fully connected layer is taken as the input of the support vector machine for training to obtain a classifier, and finally, spectrum sensing is performed. The simulation outcomes demonstrate that the algorithm suggested in this research works outperform other algorithms in this paper. When the signal-to-noise ratio is -14 dB, the false alarm probability is 0.1, the number of secondary users is 32, and the detection probability reaches 0.81.