Chronic kidney disease (CKD) is often accompanied by an imbalance in the gut microbial ecosystem. Notably, the imbalanced gut microbiota and impaired intestinal barrier are the keys to the crosstalk between the gut microbial ecosystem and CKD, which was the central point of previous studies. Traditional Chinese medicine (TCM) has shown considerable efficacy in the treatment of CKD. However, the therapeutic mechanisms have not been fully elucidated. In this review, we explored therapeutic mechanisms by which TCM improved CKD via the gut microbial ecosystem. In particular, we focused on the restored gut microbiota (i.e., short-chain fatty acid- and uremic toxin-producing bacteria), improved gut-derived metabolites (i.e., short-chain fatty acid, indoxyl sulfate, p-Cresyl sulfate, and trimethylamine-N-oxide), and intestinal barrier (i.e., permeability and microbial translocation) as therapeutic mechanisms. The results found that the metabolic pattern of gut microbiota and the intestinal barrier were improved through TCM treatment. Moreover, the microbiota-transfer study confirmed that part of the protective effect of TCM was dependent on gut microbiota, especially SCFA-producing bacteria. In conclusion, TCM may be an important exogenous regulator of crosstalk between the gut microbial ecosystem and CKD, which was partly attributable to the mediation of microbiota-targeted intervention.