The present study was conducted to investigate the nutrition status of dietary patterns and the association between dietary patterns and the risk of poor glycemic control in Chinese diabetics. The relevant data was collected from the China Nutrition and Health Surveillance 2015–2017 survey, which is a national cross-sectional surveillance program. A total of 2031 participants were included in the present statistical analysis. Food consumption was assessed through a validated and standard food frequency questionnaire. Dietary patterns were derived with reduced rank regression using hemoglobin A1c. Diabetes was diagnosed by medical institutions, glycemic control was defined as hemoglobin A1c less than 7%, poor glycemic control was defined as hemoglobin A1c greater than 7%. A multiple-variable-adjusted logistic regression, including age, living area, income level, educational attainment, body mass index, occupational physical activity, energy intake, current smoking status, current drinking status, diabetic medication use, insulin use, following diabetic diets, increased exercise, and glucose monitoring, was adjusted to explore the association between dietary patterns and the risk of poor glycemic control in diabetes. Two gender-specific dietary patterns have an increased risk of poor glycemic control and are characterized by a low intake of freshwater fish, poultry, and fruits. For male participants, the dietary pattern was characterized by a high intake of wheat and its products, a low intake of vegetables, corn and its products, shrimp and crab, and beans (Q4 vs. Q1, OR = 2.69, 95% CI: 1.76 to 4.10). For female participants, the dietary pattern was characterized by a low intake of snacks and nuts, and algae and mushroom (Q4 vs. Q1, OR = 2.18, 95% CI: 1.48 to 3.20).