In a natural ecosystem or as climatic climax community, grassland is relatively dry with a strongly seasonal climate, and sensitive to climatic changes. Most of the previous studies used remote sensing data to investigate the phenological response of grassland to climate change, while ground‐based studies covering a large geographic area were limited. In this study, using the long‐term phenological data (1981–2012) of 16 herbaceous species observed at 20 stations in Inner Mongolia, China, we first investigated the trends in three spring phenophases, including the dates of bud‐burst, first leaf unfolding, and 50% of leaf unfolding. Subsequently, multiple linear regressions between phenophases and four climatic factors (spring temperature, soil moisture, chilling temperature, and insolation) were performed to determine the relative importance of each factor on the spring phenology. To validate the resulted regression coefficients, we developed a controlled environment to investigate the factors regulating the leaf unfolding time of one dominant species (Leymus chinensis). The results showed that the study area became warmer and drier from 1981 to 2012. However, the overall changes in spring phenophases were not apparent, as there was a similar proportion of significant earlier or later trends. Such phenological changes were driven by multiple climatic factors. The warmer temperature would advance the spring phenophases, while lower soil moisture would delay them. The impact of soil moisture was significant in the experimental data, but not significant in the observation data. In addition, leaf unfolding became faster when L. chinensis experienced more chilling days, but this effect was difficult to be detected in observation data due to the weak sensitivity of the leaf unfolding time to chilling days. These findings can help us to understand how the spring phenology of typical herbaceous species responds to multiple climatic factors under the background of climate change.