Some bands in the frequency spectrum have become overloaded and others underutilized due to the considerable increase in demand and user allocation policy. Cognitive radio applies detection techniques to dynamically allocate unlicensed users. Cooperative spectrum sensing is currently showing promising results. Therefore, in this work, we propose a cooperative spectrum detection system based on a residual neural network architecture combined with feature extractor and random forest classifier. The objective of this paper is to propose a cooperative spectrum sensing approach that can achieve high accuracy in higher levels of noise power density with less unlicensed users cooperating in the system. Therefore, we propose to extract features of the sensing information of each unlicensed user, then we use a random forest to classify if there is a presence of a licensed user in each band analyzed by the unlicensed user. Then, information from several unlicensed users are shared to a fusion center, where the decision about the presence or absence of a licensed user is accomplished by a model trained by a residual neural network. In our work, we achieved a high level of accuracy even when the noise power density is high, which means that our proposed approach is able to recognize the presence of a licensed user in 98% of the cases when the evaluated channel suffers a high level of noise power density (−134 dBm/Hz). This result was achieved with the cooperation of 10 unlicensed users.