With the development of synthetic aperture radar (SAR) techniques, various imaging modes that involve single polarimetry, dual polarimetry, full polarimetry (FP), and compact polarimetry (CP) have been proposed and applied to SAR systems. This article attempts to introduce a unified framework for crop classification in southern China using FP, coherent HH/VV, and CP data. By analysing the polarimetric response from different land-cover types (including rice, banana trees, sugarcane, eucalyptus, water, and built-up areas in the experimental site) and by exploring the similarities between data in these three modes, a knowledge-based characteristic space is created and a unified classification framework is presented. Time-series data acquired by TerraSAR-X over the Leizhou Peninsula, southern China, are used in our experiments. The overall classification accuracies for data in the FP and coherent HH/VV modes are approximately 95%, and for data in the CP mode, the accuracy is 91%, which suggest that the proposed classification scheme is effective. Compared with the Wishart Maximum Likelihood (ML) classifier, the proposed method provides approximately 5.64%, 7.30%, and 6.48% higher classification accuracies in the FP, HH/VV, and circular transmit and dual circular receive modes, respectively.