The topology of the distributed cognitive radio network is volatile as influenced by the behavior of primary users, and this condition leads to the large communication overhead and low utilization of spectrum resources. A combination weighted clustering algorithm is proposed in the study to reduce the communication overhead of the distributed cognitive network and maintain the stability of the network structure. First, a clustering algorithm considering the available channel, geographic location, and experienced data (used for collecting the behavior of secondary users (SUs) in the network and the evaluation on it) of SUs is put forward through analyzing the characteristics of the idle channels in cognitive network. Three factors, namely, average channel capacity, stability, and channel quality, are converted into quantifiable values. The cluster head is determined on the basis of the three factors. Then, the cluster members and gateway nodes are determined using the weighting formula and the location information of the cluster head. Results show that the proposed clustering algorithm can generate 15% more clusters than other algorithms and reduce 40% of network communication overhead when the transmission distance between cognitive users and the channel number change. Thus, the stability of the cluster structure is maintained and the communication overhead is decreased. This study provides references for the construction of the stable distributed cognitive network.