The yak (Bos grunniens), an indigenous bovine on the Qinghai-Tibetan plateau (QTP), is reported to digest low quality forage to a greater extent and to require less protein and energy for maintenance than the introduced Qaidam cattle (Bos taurus). Ruminal bacteria play a major role in feed degradation, and therefore, we hypothesized that ruminal bacteria composition would differ between yaks and cattle, and confer an advantage to yaks for poor quality diets. To test our hypothesis, we determined the ruminal bacteria profiles, rumen fermentation parameters, and enzyme activities in these bovine species consuming a low-protein diet differing in energy level. Six castrated yaks (155 ± 5.8 kg) and 6 castrated Qaidam cattle (154 ± 8.0 kg) were used in two concurrent 4 × 4 Latin square designs with 2 additional animals of each species in each period. The animals were offered a low-protein diet of 70.4 g/kg dry matter (DM) and one of four metabolizable energy levels, namely 6.62, 8.02, 9.42, and 10.80 MJ/kg. Ruminal pH, concentrations of ammonia-N and total volatile fatty acids (VFAs), the molar proportion of acetate, and the ratio of acetate to propionate (A:P) were greater (P < 0.05), whereas the molar proportion of propionate was lesser (P = 0.043) in yaks than in cattle. With increasing dietary energy level, ruminal pH, the molar proportion of acetate and the ratio of A:P decreased linearly (P < 0.05), whereas, the concentration of total VFAs, molar proportions of propionate, butyrate, iso-butyrate, and iso-valerate and concentration of ammonia-N increased linearly (P < 0.05). The relative abundance (RA) of Firmicutes increased linearly (P < 0.01), whereas, the RA of Bacteroidetes decreased linearly (P < 0.001) with increasing energy level in both bovine species. The RAs of Prevotella and Rikenellaceae_RC9_gut_group decreased linearly (P < 0.05) with increasing energy level in both yaks and cattle. The RAs of fibrolytic (e.g., Rikenellaceae_RC9_gut_group), and H2-incorporating (e.g., Quinella) bacteria were greater (P < 0.05) in yaks than in cattle. We concluded that the two bovines differ in ruminal bacterial profiles and rumen fermentation parameters, and confer an advantage to yaks over cattle in consuming a low protein diet with differing energy level.