The Yunshang black goat is a renowned mutton specialist breed mainly originating from China that has excellent breeding ability with varying litter sizes. Litter size is an important factor in the economics of goat farming. However, ruminal microbiome structure might be directly or indirectly regulated by pregnancy-associated factors, including litter sizes. Therefore, the current experiment aimed to evaluate the association of different litter sizes (low versus high) with ruminal microbiome structure by 16S rRNA gene sequencing and metabolomic profiling of Yunshang black does. A total of twenty does of the Yunshang Black breed, approximately aged between 3 and 4 years, were grouped (n = 10 goats/group) into low (D-l) and high (D-h) litter groups according to their litter size (the lower group has ≤ 2 kids/litter and the high group has ≧ 3 kids/litter, respectively). All goats were sacrificed, and collected ruminal fluid samples were subjected to 16S rRNA sequencing and LC–MS/MC Analysis for ruminal microbiome and metabolomic profiling respectively. According to PCoA analysis, the ruminal microbiota was not significantly changed by the litter sizes among the groups. The Firmicutes and Bacteroidetes were the most dominant phyla, with an abundance of 55.34% and 39.62%, respectively. However, Ruminococcaceae_UCG-009, Sediminispirochaeta, and Paraprevotella were significantly increased in the D-h group, whereas Ruminococcaceae_UCG-010 and Howardella were found to be significantly decreased in the D-l group. The metabolic profiling analysis revealed that litter size impacts metabolites as 29 and 50 metabolites in positive and negative ionic modes respectively had significant differences in their regulation. From them, 16 and 24 metabolites of the D-h group were significantly down-regulated in the positive ionic mode, while 26 metabolites were up-regulated in the negative ionic mode for the same group. The most vibrant identified metabolites, including methyl linoleate, acetylursolic acid, O-desmethyl venlafaxine glucuronide, melanostatin, and arginyl-hydroxyproline, are involved in multiple biochemical processes relevant to rumen roles. The identified differential metabolites were significantly enriched in 12 different pathways including protein digestion and absorption, glycerophospholipid metabolism, regulation of lipolysis in adipocytes, and the mTOR signaling pathway. Spearman’s correlation coefficient analysis indicated that metabolites and microbial communities were tightly correlated and had significant differences between the D-l and D-h groups. Based on the results, the present study provides novel insights into the regulation mechanisms of the rumen microbiota and metabolomic profiles leading to different fertility in goats, which can give breeders some enlightenments to further improve the fertility of Yunshang Black goats.