Radar operating mode identification is one of the top priorities in the electronic countermeasure field for threat prediction. However, the inference speed and accuracy of existing identification methods are still not satisfactory for threat detection, and some of them need extra prior knowledge to extract features. This paper introduces an identification approach for radar operating mode to solve these problems. The variational relevance vector machine (VRVM) is presented as the feature extractor and the basic unit of identification. An improved chaotic gravity search algorithm (CGSA) is developed to increase the search breadth and optimize the hyperparameters of VRVM. Threshold-one-versus-one (TOVO) is further proposed to screen the identification results to form the final ensemble method called CGSA–VRVM–TOVO. Experimental results indicate the CGSA–VRVM–TOVO achieves 99.44% accuracy without prior knowledge. Compared with XGBoost, Random Forest, and LightGBM, our approach is 1.94%, 0.55%, and 1.11% higher in accuracy, respectively, and twice as fast as the fastest method of them all.