Persistent human papillomavirus (HPV) infection can lead to cervical intraepithelial neoplasia (CIN) and cervical cancer, posing serious threats to the health of women. Although the cervicovaginal microbiota is strongly associated with CIN, the dynamics of the microbiota during CIN development are unknown. In this retrospective cohort study, we analyzed 3‐year longitudinal data from 72 patients diagnosed with a persistent HPV infection almost all caused by high‐risk HPV types. Patients were categorized into groups with HPV persistent infection (n = 37), progression to CIN (n = 16), and CIN regression (n = 19) based on infection outcome during the follow‐up period. Furthermore, 16S rRNA gene sequencing was performed on consecutively collected cervical samples to explore the composition and dynamics of the cervicovaginal microbiota during the development and regression of CIN. Our results showed that the composition of the cervicovaginal microbiota varied among women with different HPV infection outcomes and remained relatively stable during the follow‐up period. Notably, the serial follow‐up data showed that these microbial alterations were present for at least 1–2 years and occurred before pathologic changes. In addition, microbial markers that were highly discriminatory for CIN progression or regression were identified. This study provides evidence for a temporal relationship between changes in the cervicovaginal microbiota and the development of CIN, and our findings provide support for future microbial intervention strategies for CIN.