This study compared the growth performance, serum biochemical indicators, rumen fermentation parameters, rumen bacterial structure, and fecal bacterial structure of cattle and yaks fed for two months and given a feed containing concentrate of a roughage ratio of 7:3 on a dry matter basis. Compared with cattle, yak showed better growth performance. The serum biochemical results showed that the albumin/globulin ratio in yak serum was significantly higher than that in cattle. Aspartate aminotransferase, indirect bilirubin, creatine kinase, lactate dehydrogenase, and total cholesterol were significantly lower in yaks than in cattle. The rumen pH, acetate to propionate ratio, and acetate were lower in yaks than in cattle, whereas the lactate in yaks was higher than in cattle. There were significant differences in the structure of ruminal as well as fecal bacteria between cattle and yaks. The prediction of rumen bacterial function showed that there was a metabolic difference between cattle and yaks. In general, the metabolic pathway of cattle was mainly riched in a de novo synthesis of nucleotides, whereas that of yaks was mainly riched in the metabolic utilization of nutrients. This study provides a basis for understanding a rumen ecology under the condition of a high concentrate diet.