Assessing the Validity of Survey Measures for News Exposure through Digital Footprints: Evidence from Spain and the UK

Abstract

This paper assesses the performance of three commonly used type of questions -open-ended, check-all and forced choice-for capturing retrospective online news exposure, combining both survey and webtracking data. It examines the performance of these different survey questions considering both systematic and random error in two unexplored non-US contexts: Spain and the UK. Results show that the check-all question produces on average the most accurate -i.e. less biased-estimates of observed exposure. Some motivational and cognitive factors underlying bias in self-reports are explored. Findings reveal that the characteristics of outlets are associated with systematic error. Finally, we find that media systems matter for accuracy -where media fragmentation is high (Spain), accuracy is low across all questions; where it is low (UK), accuracy is high across all questions. In a final section, we highlight the methodological and theoretical contributions of our study and provide some recommendations.

Towards a model that measures the impact of disinformation on elections

“…The question of exposure to misinformation is also not as banal as it seems. Sociological research shows that people are not good at remembering if they have noticed a specific news item, or if they have, where they noticed it (Cardenal et al 2022). Exposure also has to be put into the context of the broader dynamics of the information space (see, e.g.…”

Googling Politics? The Computational Identification of Political and News-related Searches from Web Browser Histories

“…Browsing data has been used in news referrals research by utilising the sequence of browsing to identify how people access news websites, including through search engines (Cardenal et al, 2022;Guess et al, 2020;J. Möller et al, 2019;Vermeer et al, 2020;.…”