Background: The epidemiological evidence on the association of sleep quality on anxiety symptoms has been inconclusive. This study aimed to explore the association between sleep quality and anxiety symptoms in rural Chinese population and investigate whether age, lifestyles, and chronic diseases modified this association. Methods: A total of 27,911 participants aged 18-79 years from the Henan Rural Cohort Study were included in the study. Sleep quality was assessed using the Pittsburgh Sleep Quality Index (PSQI) scale. Poor sleep quality was defined as PSQI ≥6. Anxiety symptoms were evaluated with the two-item generalized anxiety disorder scale (GAD-2). Individual with score ≥ 3 was viewed as having anxiety symptoms. Logistic regression and restricted cubic spline were conducted to examine the association of sleep quality with anxiety symptoms. Results: Altogether, 6087 (21.80%) participants were poor sleepers and 1557 (5.58%) had anxiety symptoms. The odds of anxiety were increased with increment of PSQI score after fitting restricted cubic splines. The poor sleep quality was associated with a higher possibility of anxiety symptoms [odd ratio (OR): 4.60, 95% confidence interval (CI): 3.70-5.72] in men, and (OR: 3.56, 95% CI: 3.10-4.09) in women for multivariable analysis. Further, stratified analyses showed that the effect of sleep quality on anxiety symptoms could be modified by age, marital status, smoking status, drinking status, hypertension, and type 2 diabetes mellitus. Conclusions: A dose-response association between PSQI score and anxiety symptoms was found. In addition, the relationship between poor sleep quality and greater anxiety symptoms was observed in this rural population, especially in participants aged ≥60 years and those with unhealthy habits or had a chronic disease. Trial registration: The trial was prospectively registered on July 6, 2015 and available online at ClinicalTrials.gov ID: ChiCTR-OOC-15006699.