Cognitive radio (CR) is defined as a procedure that uses the range with and without impedance. Elements of psychological radio systems incorporate spectrum sensing, spectrum sharing, spectrum mobility and spectrum decision. This manuscript proposes cooperative spectrum sensing (CSS) with filtered bank multi carrier (FBMC) in cognitive radio network (CRN) for mitigating the interference with proficient bandwidth utilization. Here, five primary users (PU) and one secondary user (SU) are considered. The secondary user occupies the slot only in the absence of primary user. During cooperative spectrum sensing with FBMC evaluation, it produces problem in hidden terminal, false alert and auxiliary client identification with effective radio spectrum sharing for the secondary users, which automatically reduces the channel capacity, energy efficiency, and channel interference. To overcome the issues, optimal red deer algorithm (ORDA) is used in FBMC Weight parameters. The proposed method is executed in MATLAB platform. The simulation outcomes demonstrate that the performance of the proposed CSS-FBMC-ORDA has high efficiency with less error rate. The proposed CSS-FBMC-ORDA attains higher efficiency of 3.99%, 8.90%, and 4.09%, higher reliability of 5.66%, 9.44%, and 2.43%, lower bit error rate (BER) of 4.756%, 4.86%, and 8.97% when compared with the existing methods, such as spectrum resource optimization for non-orthogonal multiple access (NOMA) based cognitive radio at 5G communications joint optimization algorithm (JOA) (CSS-CRN-NOMA-JOA), maximizing the total throughput for generalized frequency division multiplexing (GFDM) system using hybrid particle swarm optimization (PSO)-pattern search (PSO-PS) approach (CSS-CRN-GFDM-Hyb PSO-PS), energy efficiency for various spectrum sensing scenarios using a novel hybridization of particle swarm optimization (PSO) with gravitational search algorithm (GSA) (CSS-CRN-OFDM-Hybrid PSO-GSA) respectively.