Plant communities and their environments are a vital part of synecology research. In this study, we investigated the characteristics of three typical medicinal perennial herbs, Glycyrrhiza uralensis, Rheum altaicum, and Ferula sinkiangensis, and examined their response to local soil properties in Altay Prefecture, China. A total of 29 species belonging to 15 families and 25 genera were recorded. In terms of the target medicinal plants, the importance value was low and community structures were exceedingly simple. Quantitative classification based on WARD cluster analysis suggested that each medicinal plant can be classified into one of three types: annual herbaceous, perennial herbaceous, and subshrub or shrub. Interestingly, the plants gradually transformed from exhibiting nonresistance to xerophytes or halophytes. An investigation of the soil properties beneath the medicinal plants showed that nutrients in black soil were much more abundant than those in sandy and saline soil. Except for leaching phenomenon, the nutrient contents in the soil surface layer (0–10 cm) were higher than those in deep layers (10–20 cm and 20–40 cm), and to some extent, the nutrient contents were inversely proportional to the depth of the soil. The redundancy analysis (RDA) results of the medicinal plants and their relationship with soil properties indicated that the main soil variables impacting the distribution of G. uralensis were available potassium (AK), aspect (ASP), soil moisture (SM), total nitrogen (TN), and total phosphorus (TP); SM, electric conductivity (EC), elevation (ELE), ASP, pH value (pH), available nitrogen (AN), soil organic content (SOC), and the carbon/nitrogen (C/N) ratio had positive effects on the distribution of R. altaicum. F. sinkiangensis grew better in habitats with high contents of SM, EC, TN, AN, available phosphorus (AP), total potassium (TK), and AK. This study aimed at providing effective suggestions for artificial cultivation, conservation, and resilience of Chinese medicinal plants.