The health burden of Parkinson’s disease (PD) and diabetes increases rapidly in China. However, no population-based study of the association between glucose lowering agents and PD incidence has been conducted in mainland Chinese population. Preclinical studies indicate that thiazolidinediones (TZDs) have neuroprotective effects against PD through stimulating peroxisome proliferator-activated receptor gamma. Nevertheless, debate remains in human studies. We assembled a retrospective cohort of type 2 diabetes mellitus (T2DM) patients who were new users of TZDs or alpha glucosidase inhibitors (AGIs) using the Yinzhou Regional Health Care Database. A Cox model with inverse probability of treatment weighting (IPTW) was applied to estimate the hazard ratio (HR) of PD incidence associated with the use of TZDs compared with AGIs. The final cohort included 12,704 new users of TZDs and 49,696 new users of AGIs. The incidence of PD was 135 per 100,000 person-years in TZD users and 203 per 100,000 person-years in the AGI group. An inverse association between use of TZDs and incidence of PD, with a HR of 0.74 (95% confidence interval, 0.59–0.92), was observed after adjusting for potential confounding using IPTW. The results of various subgroup analyses and sensitivity analyses were consistent with the findings of the primary analysis. Our results indicated that the use of TZD is associated with a decreased risk of PD incidence in a mainland Chinese population with T2DM. Given the heavy disease burden of PD and diabetes in China, these findings could provide some evidence for developing effective prevention and control measures to reduce the future incidence of PD in China.