Yak (Bos grunniens) is a unique large ruminant species in the Qinghai-Tibetan Plateau (QTP). Changing the energy levels of their rations can significantly improve their growth performance. Therefore, studying the effects of dietary energy levels on the rumen microflora and metabolites of yak is crucial for enhancing the development of the yak industry. Currently, there is a lack of understanding regarding the impact of feeding energy diets on rumen fermentation parameters, microbial functions, and metabolites. This study was designed to determine the appropriate energy level for feeding yak. Three test diets with metabolizable energy levels of 7.57 MJ/kg, 9.44 MJ/kg, and 11.9 MJ/kg were used and the concentration of volatile fatty acids (VFA) in rumen fluid was measured. The microbial communities, functions, and metabolites in yaks were studied by 16S rRNA sequencing, metagenome, and LC-MS non-targeted metabolomics to investigate the relationships among rumen fermentation parameters, microbial diversity, and metabolites. Ration energy levels significantly affect total VFA, acetate, propionate, butyrate, iso-valerate, valerate, and acetate/propionate (p < 0.05). At the phylum level, the dominant phyla in all three treatment groups were Bacteroidota, Firmicutes, and Actinobacteriota. At the genus level, the abundance of the unclassified_o__Bacteroidales, norank_f_Muribaculaceae, Lachnospiraceae_NK4A136_group, and Family _XIII_AD3011_group showed significant differences (p < 0.05) and were significantly correlated with differential metabolites screened for phosphatidylcholine [PC(16:0/0:0), PC(18:3/0:0)], uridine 3′-monophosphate, and adenosine monophosphate, etc. CAZymes family analysis showed that GHs and CEs differed significantly among the three groups. In addition, differential metabolites were mainly enriched in the pathways of lipid metabolism, nucleotide metabolism, and biosynthesis of other secondary metabolites, and the concentrations of differential metabolites were correlated with microbial abundance. In summary, this study analyzed the effects of ration energy levels on rumen microorganisms and metabolites of yaks and their relationships. The results provided a scientific basis for the selection of dietary energy for yaks in the house feeding period in the future.