Using high-throughput sequencing, this study aimed to explore the response of soil microbial community and Baby Chinese cabbage yield to the reduction of chemical fertilizers combined with bio-organic fertilizer in the Gansu plateau, China. Our experiments consisted of conventional fertilizer (CK), 30% chemical fertilizer reduction + 6,000 kg bio-organic fertilizer (T1), 30% chemical fertilizer reduction + 9,000 kg bio-organic fertilizer (T2), 40% chemical fertilizer reduction + 6,000 kg bio-organic fertilizer (T3), and 40% chemical fertilizer reduction + 9,000 kg bio-organic fertilizer (T4). Compared with CK, soil microbial diversity and richness were higher for all treatments with added bio-organic fertilizer. PCoA showed that the bacterial and fungal communities in T2 and T4 were similar to each other. Redundancy and Spearman's correlation analyses of microbial communities and soil physicochemical properties revealed that reductions in chemical fertilizer rate combined with bio-organic fertilizer had a stronger impact on the fungal than the bacterial community. They also increased the relative abundance of the dominant bacterial and fungal phyla. Baby Chinese cabbage yield was relatively higher under the combined bio-organic fertilizer plus reduced chemical fertilizer rate with T2 showing the highest yield. Therefore, this approach is feasible for sustainable agricultural, cost-effective and profitable crop production.