Purpose: China is the second highest tuberculosis (TB) burden in the world, and TB patients in the rural areas are about twice as many as urban patients. The purpose of present study was to explore the roles of medication adherence, doctor-patient trust and communication on treatment effects, and its inequality between urban and rural areas. Methods: There were 564 eligible TB patients, from four tuberculosis hospitals in China, participating in this cross-sectional study. They filled out questionnaires regarding sociodemographic characteristics, medication adherence, treatment effect, doctor-patient trust, and communication. The structural equation model (SEM) was applied to explore the hypotheses in this study. All statistical analysis was done by SPSS 25.0 and Mplus 7.0 statistical software. Results: This study included 267 (47.34%) urban and 297 (52.66%) rural eligible TB patients. The data fitted the research model well, and the urban TB patients reported better treatment effect than the rural ones (P=0.027). Overall, treatment adherence positively predicted treatment effect (Est.=0.353, P<0.001); doctor-patient communication positively influenced treatment adherence (Est.=0.214, P=0.002); and treatment adherence positively mediated the role of communication on treatment effect (Est.=0.076), 95% CI (0.026, 0.152). While in the grouping model, the urban patients' treatment effect was only influenced by adherence (Est. =0.286, P=0.003); for the rural patients, treatment adherence (Est.=0.464, P<0.001) and doctor-patient trust (Est.=0.382, P=0.019) directly predicted treatment effects, and treatment adherence positively mediated the role of doctor-patient communication on treatment effect (Est.=0.175, P=0.006). Conclusion: The treatment effect of TB patients, from urban and rural China, was influenced by a different mechanism, among which rural TB patients need not only improve the treatment adherence but also establish good doctor-patient trust and communication to improve treatment effects. These findings provided a theoretical guide on treatment and control for rural TB patients.