Twelve Holstein bulls were used in a 4 × 4 Latin square design to investigate the effects of using whole-crop wheat hay (WCWH) as a substitute for Leymus chinensis (LC) on apparent digestibility, plasma parameters, ruminal fermentation, and microbial communities. Experimental treatments were four proportions of WCWH, 0, 33, 67, and 100%, as a substitute for LC (WCWH0, WCWH33, WCWH67, and WCWH100, respectively). The WCWH100 group showed a higher nutritional intake of crude protein (CP) and higher apparent digestibility of organic matter (OM), CP, and ether extract (EE) than the WCWH0 group (P < 0.05). Urea N, NH3-N, isobutyrate and isovalerate levels were higher (P < 0.05) in the WCWH100 group than in the WCWH0 group. 16S rRNA high-throughput sequencing analysis revealed similarities in the community composition, species diversity and relative abundance of dominant bacteria at the phylum and genus levels among the four groups. Collectively, our data indicated that WCWH can be used to replace LC in the diet of finishing dairy bulls without having a negative impact on apparent digestibility, plasma parameters, and ruminal bacteria composition. These results offer the first deep insight into the effects of replacing LC with WCWH on the performance parameters and rumen microbiota in Holstein bulls, and may aid in ruminant farming.