Excessive exercise without adequate rest can lead to overtraining syndrome, which manifests a series of side effects, including fatigue, gut dysbiosis, and decremental sports performance. Konjac glucomannan (KGM) is a plant polysaccharide with numerous health-improving effects, but few studies reported its effects on the gut microbiome, endurance, and strength in an overtraining model. This study assessed the effect of KGM on gut microbiome, endurance, and strength in mice with excessive exercise. Three doses of KGM (1.25, 2.50, and 5.00 mg/mL) were administrated in drinking water to mice during 42 days of a treadmill overtraining program. The results showed that excessive exercise induced a significant microbial shift compared with the control group, while a high dose (5.00 mg/mL) of KGM maintained the microbial composition. The proportion of Sutterella in feces was significantly increased in the excessive exercise group, while the moderate dose (2.50 mg/mL) of KGM dramatically increased the relative abundance of Lactobacillus and SCFA production in feces. Additionally, the moderate dose and high dose of KGM counteracted the negative effects of excessive exercise on strength or/and endurance (43.14% and 39.94% increase through a moderate dose of KGM, Bonferroni corrected p < 0.05, compared with the excessive exercise group). Therefore, it suggests that KGM could prevent overtraining and improve sports performance in animal models.