Planting energy sorghum to remove soil cadmium (Cd) has been selected as an effective phytoremediation method in subtropical farmland in China in recent years. Nevertheless, the effects of energy sorghum species and cropping systems on Cd removal by energy sorghum are still not fully understood. In the present work, biomass sorghum (BS) and sweet sorghum (SS) were planted for screening varieties and comparing the applicability of cropping systems to remove Cd from contaminated soils through batch field experiments. The results indicated that BS had a higher plant height (4.70–75.63%), lower water content in the shoot (4.78–13.49%), greater dry biomass yield (13.21–125.16%), and stronger Cd removal (average 45.71%) compared with SS. Significant differences (p < 0.05) were observed in the agronomic traits and Cd accumulation of energy sorghums with genetic regulation of varieties. Pearson correlation coefficients analysis and the structural equation model (SEM) showed that plant height was the crucial agronomic parameter affecting the dry biomass yield, and Cd concentration in the stem was the key factor for evaluating the Cd extraction ability of energy sorghums, which indirectly determined the removal of Cd by energy sorghum together. Furthermore, the regeneration cropping system was the most suitable because of the adaptation to climatic conditions of energy sorghums in subtropical regions of China, and its Cd removal efficiency increased by more than 49% compared with double cropping and single cropping systems, respectively. Our study provides valuable information for the phytoremediation of Cd-contaminated soil in Chinese subtropical farmland.