The construction and operation of high-speed rail (HSR) has become an important policy for China to achieve efficiency and fairness and promote high-quality economic growth. HSR promotes the flow of production factors such as labor and capital and affects economic growth, and may further affect urban land use efficiency (ULUE). To explore the impact of HSR on ULUE, this paper uses panel data of 284 cities in China from 2005 to 2018, and constructs Propensity Score Matching-Differences in Differences model to evaluate the effect of HSR on ULUE. The result of entire China demonstrates that the HSR could significantly improves the ULUE. Meanwhile, this paper also considers the heterogeneity of results caused by geographic location, urban levels and scales. It demonstrates that the HSR has a significantly positive effect on ULUE of Eastern, Central China, and large-sized cities. However, in Western China, in medium-sized, and small-sized cities, the impact of HSR on ULUE is not significant. This paper concludes that construction and operation of HSR should be linked to urban development planning and land use planning. Meanwhile, the cities with different geographical locations and scales should take advantage of HSR to improve ULUE and promote urban coordinated development.