This cohort study on the entire population of an Italian Province assessed the incidence of potentially vaccine-related serious adverse events (PVR-SAEs) by COVID-19 vaccination status. From January 2021 to July 2022, we extracted all deaths and hospitalizations due to several cardiovascular diseases, pulmonary embolism, and deep vein thrombosis from National Healthcare System official data. During the follow-up, 5743 individuals died, and 2097 were hospitalized for PVR-SAEs. Vaccinated subjects (n = 259,821) did not show an increased risk of all-cause death, non-COVID death, or any PVR-SAEs, as compared to the unvaccinated (n = 56,494). These results were consistent across genders, age-classes, vaccine types, and SARS-CoV-2 infection status and did not vary in Cox models adjusting for age, gender, SARS-CoV-2 infection, and selected comorbidities. In the infected population, any dose of vaccine was associated with a lower likelihood of death and PVR-SAE. In the uninfected population, subjects who received one or two doses showed a significantly higher incidence of most outcomes, likely due to a large selection bias introduced by the Italian restriction policies targeting uninfected subjects who received less than three doses. In conclusion, COVID-19 vaccination was not associated with an increase of mortality or selected PVR-SAEs incidence. Further research is warranted to evaluate the long-term safety of COVID-19 vaccines.