The population with diabetes is more susceptible to severe acute respiratory syndrome-associated coronavirus (SARS-CoV)-2, and have a significantly higher coronavirus disease-2019 (COVID-19) mortality rate. Previous studies have shown low willingness for the COVID-19 vaccination, and there are limited reports on the behavior and relevance of the COVID-19 vaccination. This study aimed to determine the uptake behavior and associated factors of the COVID-19 vaccine. In our cross-sectional questionnaire-based clinical study, 645 diabetes patients affiliated with two affiliated hospitals of Changzhi Medical College completed the questionnaire between June to October 2021. The health belief model (HBM) was used in examining factors influencing vaccination behavior. After adjusting for covariates with significant differences in social background characteristics, a multivariable logistic regression was used to determine predictors related to uptake in COVID-19 vaccination. A total of 162 vaccinated and 483 unvaccinated eligible diabetic patients were recruited. Patients who believed that the COVID-19 syndrome is severe (aOR3.67, 95%CI 1.88–7.17; p < 0.001), believe that vaccination can significantly reduce the risk of SARS-Cov-2 infection (aOR3.48, 95%CI 1.80–6.73; p < 0.001), believe that vaccination is beneficial to themselves and others (aOR 4.53, 95%CI 1.71–11.99; p = 0.002), think that relatives’ vaccination status has a positive impact on their vaccination behavior (aOR 5.68, 95%CI 2.83–11.39; p < 0.001), and were more likely to be vaccinated; worrying about the adverse health effects of COVID-19 vaccination (aOR 0.18, 95%CI 0.09–0.35; p < 0.001) was negatively correlated with COVID-19 vaccination behavior. Health care workers should provide targeted informative interventions based on the safety and protective effects theory of HBM to improve vaccination behavior in patients with diabetes.