Chinese alfalfa (Medicago sativa) is one of the most widely planted species in China. It has considerable economic potential and plays an important role in soil and water conservation. In order to conduct scientific cultivation of Chinese alfalfa, we collected 100 occurrence records from herbarium and publications and 19 climatic variables from BIOCLIM to simulate potential suitable habitat and identified the key climatic factors of Chinese alfalfa by MaxEnt and GIS software. The result shows that the MaxEnt model performed well, with an average test AUC value of 0.86 with 10-fold cross validation. The potential distribution of Chinese alfalfa is mainly in arid and semi-arid areas of north and northwest China, about 15.2% (1.46 million km2) of China’s total land area, and the highly suitable area is Loess Hilly region and Xinjiang. The main climatic factors affecting the distribution of this species is hydrological-related factors (PDM, PS, AP, PDQ and PCQ), which explained 58.6% of the variation, and the climatic factors limiting the southern, northern, northwestern and Tibetan plateau boundaries were PDM, AMT, AP and MTCM, respectively. The climatic thresholds of the core area of Chinese alfalfa are 0.0–14.0 mm of PDM, 23.8–108.2% of PS, 3.9–15.5 °C of AMT, 14.0–664.0 mm of AP, 1.0–47.0 mm of PDQ, 2.0–51.0 mm of PCQ. The results improve our understanding of limiting climatic factors for Chinese alfalfa and suggest a priority management measures for areas with corresponding limiting climatic factor.