BackgroundVaccination is considered an effective approach to deter the spread of coronavirus disease (COVID-19). However, vaccine hesitancy is a common issue that makes immunization programs more challenging. To promote vaccination in a targeted and efficient way, this study aims to develop and validate a measurement tool for evaluating the importance of influencing factors related to COVID-19 vaccination intention in China, and to examine the demographic differences.MethodsIn study 1, we developed a Factor Importance Evaluation Questionnaire (FIEQ) based on semi-structured interview results and used exploratory factor analysis (EFA) to explore its factor structure. In study 2, we verified the four-factor structure of FIEQ by confirmatory factor analysis (CFA). We then administered FIEQ to Chinese participants and conducted a student t-test and analysis of variance to examine the differences in the importance evaluation of factors based on gender and educational level.ResultsIn study 1, we developed a four-factor construct and retained 20 items after EFA (N = 577), with acceptable reliability (alpha = 0.87) and validity. In study 2, we found that the model fit was good (χ2 = 748.03 (162), p < 0.001, GFI = 0.949, RMSEA = 0.049, SRMR = 0.048, AGFI = 0.934), and reliability was acceptable (alpha = 0.730) (N = 1,496). No gender difference was found in factor importance. However, individuals with different educational levels reported significantly different importance evaluations of three factors, including perceived benefits and social norms (F = 3.786, p = 0.005), perceived influences from reference groups (F = 17.449, p < 0.001), and perceived risks (F = 2.508, p = 0.04).ConclusionThis study developed and validated FIEQ for measuring the importance of influencing factors related to the COVID-19 vaccination intention in Chinese participants. Moreover, our findings suggest that the educational level may play a role in how individuals evaluate the importance of factors. This study provides insights into the concerns that individuals have regarding vaccination and offers potentially effective and targeted strategies for promoting COVID-19 vaccination.