Overestimation of COVID-19 Vaccination Coverage in Population Surveys Due to Social Desirability Bias: Results of an Experimental Methods Study in Germany

Abstract

In Germany, studies have shown that official coronavirus disease 2019 (COVID-19) vaccination coverage estimated using data collected directly from vaccination centers, hospitals, and physicians is lower than that calculated using surveys of the general population. Public debate has since centered on whether the official statistics are failing to capture the actual vaccination coverage. The authors argue that the topic of one’s COVID-19 vaccination status is sensitive in times of a pandemic and that estimates based on surveys are biased by social desirability. The authors investigate this conjecture using an experimental method called the item count technique, which provides respondents with the opportunity to answer in an anonymous setting. Estimates obtained using the item count technique are compared with those obtained using the conventional method of asking directly. Results show that social desirability bias leads some unvaccinated individuals to claim they are vaccinated. Conventional survey studies thus likely overestimate vaccination coverage because of misreporting by survey respondents.

COVID-19 vaccination and the behavioral immune system: The newcomer and the old friend get along in preventing infection

“…Because of the sensitive nature of the question of one's vaccination, it is possible that individuals with antivax beliefs declined participation or misreported their vaccination status. However, there is evidence that providing participants with an anonymous way to report their vaccination status (as we did in the present study) minimizes misreporting of COVID-19 vaccination ( Wolter et al, 2022 ).…”

Vaccination against SARS-CoV-2 in pregnancy during the Omicron wave: the prospective cohort study of the Italian obstetric surveillance system

“…The information about vaccination was collected by asking women and could be biased by social desirability [ 23 ]. Therefore, an overestimation of the vaccine uptake cannot be excluded.…”

Accessing Healthcare During the COVID-19 Pandemic: Experiences of NYC residents living in North and Central Brooklyn, the South Bronx, and East and Central Harlem

“…Social desirability bias may also be present, particularly with respect to those who spoke directly to an interviewer over the telephone. (33) Recruitment into the Healthy NYC panel involved a hybrid approach with mailed physical letters, emails and mobile-based text message to try to reach people in different ways and minimize recruitment bias. Although study participants were recruited from a probability-based sample, there may be differences between the BNH area population and BNH residents who chose to be part of the Healthy NYC panel, as well as the panel members who responded to this speci c survey cycle.…”