This study investigates the effectiveness of vegetation reinforcement on the stability of a slope with red-bed soft rock in a slope along the Xining-Chengdu railway, China. Four kinds of vegetation were considered to reinforce the soil and the slope. The rooted soil parameters were determined based on the laboratory tests. A numerical model was developed based on the actual geometry and soil layer distributions. The soils were modeled as elastic perfectly plastic materials and the vegetation reinforcement was represented as addition cohesion of a series of subsoil layers within a given depth. The effectiveness of vegetation on slope reinforcement under both dry and rainfall conditions was investigated regarding this case. The potential failure surface and corresponding factor of safety of the red-bed soft rock slope for those different conditions were analyzed and compared. It has been found that the addition of vegetation increased the safety of slope stability whether the slope is under a dry condition or a rainfall condition, while the increasing proportion of factor of safety due to vegetation reinforcement for this case is very limited. The results and findings in this study are still significant for the practitioner to evaluate the reasonability of vegetation reinforcement.