Folk Theories of Avoiding Content Moderation: How Vaccine-Opposed Influencers Amplify Vaccine Opposition on Instagram

Abstract

This study analyzes how vaccine-opposed users on Instagram share anti-vaccine content despite facing growing moderation attempts by the platform. Through a thematic analysis of Instagram content (in-feed and ephemeral “stories”) of a sample of vaccine-opposed Instagram users, we explore the observable tactics deployed by vaccine-opposed users in their attempts to avoid content moderation and amplify anti-vaccination content. Tactics range from lexical variations to encode vaccine-related keywords, to the creative use of Instagram features and affordances. The emergence of such tactics exists as a type of “folk theorization”—the cultivation of non-professional knowledge of how visibility on the platform works. Findings highlight the complications of content moderation as a route to minimizing misinformation, the consequences of algorithmic opacity and knowledge-building within problematic online communities.

Consumer Morality Formation on Social Media Platforms: The Case of Guns in Brazil

“…Platforms and SMIs need to be held accountable—i.e., through government regulation—for the spread of moral discourses when they potentially implicate negative consequences for society, since platforms have the technical capacity to monitor and restrict the access of lay consumers to content that could potentially damage the public interest. Recent cases of SMIs spreading misinformation about COVID-19 vaccines (Moran, Grasso, and Koltai 2022) and sharing imagery that could harm national parks and monuments (Ray Chaudhury, Nafees, and Perera 2021) illustrate our argument. Hence, the process of morality formation illuminates how SMIs act as moral influencers, a consideration that may attract the attention of government regulators and the brands that work with SMIs.…”

Perceived experts are prevalent and influential within an antivaccine community on Twitter

“…By filtering the set of accounts considered in this analysis to construct the coengagement network, our findings are further limited to a subset of users who receive repeated engagement from other accounts. Keyword-based methods to collect posts about vaccination may introduce additional biases into the dataset by excluding slang, misspellings, and efforts to evade moderation by using codewords ( 92 ). The generalizability of these results should be assessed on different social media platforms ( 4 , 9 , 13 ).…”

The Power of Social Media: Stigmatizing Content Affects Perceptions of Mental Health Care

“…For example, our findings are consistent with those arguing the potentially harmful effects of social media on disordered eating and body image dissatisfaction (e.g., Harriger et al, 2022; Logrieco et al, 2021; Roberts et al, 2022), suicidal ideation (e.g., Spitzer et al, 2023), and overall subjective well-being (e.g., Brooks, 2015), among others. Similarly, research suggests that social media plays a role in shaping attitudinal factors associated with people’s health behaviors, such as vaccine hesitancy (e.g., Moran et al, 2022; Wilson & Wiysonge, 2020), with tweets about health-related information often spreading rapidly online (Wang et al, 2021) and individuals with greater health-related conspiracy beliefs reporting using social media as a source of health information (Allington et al, 2020).…”