There has been growing interest in the classification of interference types in communication systems, especially under large samples and unknown interference, which severely restrict anti-jamming performance of the system. In this paper, we present two signal approximation algorithms for classification restricted different conditions, and the transform learning label consistency (TLLC) is embedded into the evaluation owing to the imperfect performance for classification and feature library. First, the interference signals are converted into the signal feature space, and then the interference processing and feature extraction are conducted based on the Hilbert signal space theory. Second, the projection approximation (PA) for signal approximation is used to approximate the unknown interference, and the restricted projection property is demonstrated as well. Furthermore, in order to ease the restrictions, the sparse approximation (SA) for interference signals is demonstrated. Moreover, an unsupervised learning method and the unknown interference classifier are proposed based on the self-organizing map (SOM) neural network. Based on l1 minimization functions, we improve the accuracy of TLLC with sparse approximation, which is more suitable for general interference signals. Finally, the simulation results demonstrate that, compared with the traditional classification method, the proposed method improves the classification accuracy of known interference by 3.44%. In this case, the overall accuracy is close to that of the supervised learning method, and the speed of processing interference is increased by more than 10 times. When the SNR reaches 5 dB, the accuracy of unknown interference classification exceeds 94%. Finally, yet importantly, owing to the imperfect performance for classification and feature library at present, we acquire the final accuracy for them at 92.23% by intervening measures, and the time availability also has been obtained advantages on signal processing.