Missing Data in Experiments: Challenges and Solutions

Gomila, Robin; Clark, Chelsey S.

doi:10.31234/osf.io/mxenv

Cited by 8 publications

(7 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the analyses reported here, we excluded cases listwise based on missing data. We also imputed responses using inverse probability weighting, and this analysis appears in the SI Appendix ( 63 ). In both cases, the conclusions reached from our analyses were identical.…”

Section: Methodsmentioning

confidence: 99%

Testing the efficacy of three informational interventions for reducing misperceptions of the Black–White wealth gap

Callaghan

Harouni

Dupree

et al. 2021

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

Americans remain unaware of the magnitude of economic inequality in the nation and the degree to which it is patterned by race. We exposed a community sample of respondents to one of three interventions designed to promote a more realistic understanding of the Black–White wealth gap. The interventions conformed to recommendations in messaging about racial inequality drawn from the social sciences yet differed in how they highlighted data-based trends in Black–White wealth inequality, a single personal narrative, or both. Data interventions were more effective than the narrative in both shifting how people talk about racial wealth inequality—eliciting less speech about personal achievement—and, critically, lowering estimates of Black–White wealth equality for at least 18 mo following baseline, which aligned more with federal estimates of the Black–White wealth gap. Findings from this study highlight how data, along with current recommendations in the social sciences, can be leveraged to promote more accurate understandings of the magnitude of racial inequality in society, laying the necessary groundwork for messaging about equity-enhancing policy.

show abstract

Section: Methodsmentioning

confidence: 99%

Testing the efficacy of three informational interventions for reducing misperceptions of the Black–White wealth gap

Callaghan

Harouni

Dupree

et al. 2021

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

show abstract

“…First, I demonstrate that doctor assignment does not predict participation in the survey or nonresponse to specific questions. Second, I demonstrate that my main results are robust to models where I employ inverse probability weighting in order to account for attrition (41). Lastly, I demonstrate that even though my sample of respondents is older and composed of more female patients than the population of people receiving care in the observed clinics, this sample is similar to a representative sample of Jewish Israelis responding to a survey implemented by the Israeli Democracy Institute several months before my intervention.…”

Section: Discussionmentioning

confidence: 62%

Diversity in health care institutions reduces Israeli patients’ prejudice toward Arabs

Weiss

2021

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

Diversity in the lines of public institutions, such as hospitals, schools, and police forces, is thought to improve provision for minority group members. Nonetheless, whether and how diversity in public institutions shapes majority citizens’ prejudice toward minorities are unclear. Building on insights from the intergroup contact literature, I suggest that diversity in public institutions can facilitate positive intergroup contact between majority group members and minorities in elevated social positions. Such unique interactions, which exceed the equal status condition for effective intergroup contact, can serve to reduce prejudice and facilitate more inclusive attitudes among majority group members. To test this expectation, I focus on health care provision—a leading sector with regard to minority representation. Leveraging a natural experiment unfolding in 21 Israeli medical clinics where Jewish patients are haphazardly assigned to receive care from Jewish or Arab doctors and embedding prejudice-related questions in a routine evaluation survey, I demonstrate that brief contact with an Arab doctor reduces prejudice. Specifically, contact with an Arab doctor reduces Jewish patients’ exclusionary preferences toward Arabs by one-sixth of an SD and increases Jewish patients’ optimism about peace by a 10th of an SD. The modest magnitude of these effects is similar to the impact of well-powered interventions recently reviewed in a meta-analysis of prejudice reduction experiments. These findings emphasize how the demographic makeup of public institutions can reduce mass prejudice, even in a context of intractable conflict.

show abstract

“…Using simulation 3 , we generated a complete dataset (i.e., without missing values) that includes demographic and pretest variables for all 20,000 employees of this hypothetical company (Gomila & Clark, 2019). We then generated the dependent AT E = 1.00…”

Section: Description Of the Population Datamentioning

confidence: 99%

Missing data in experiments: Challenges and solutions.

Gomila¹,

Clark²

2022

Psychological Methods

Self Cite

View full text Add to dashboard Cite

Missing data is a common feature of experimental datasets. Standard methods used by psychology researchers to handle missingness rely on unrealistic assumptions, invalidate random assignment procedures, and bias estimates of effect sizes. We describe different classes of missing data typically encountered in experimental datasets, and we discuss how each of them impacts researchers' causal inferences. In this tutorial, we provide concrete guidelines for handling each class of missingness, focusing on two methods that make realistic assumptions: i) Inverse Probability Weighting (IPW) for mild instances of missingness, and ii) Double Sampling and Bounds for severe instances of missingness. After reviewing the reasons why these methods increase the accuracy of researchers' estimates of effect sizes, we provide lines of R code that researchers may use in their own analyses.

show abstract

Missing Data in Experiments: Challenges and Solutions

Cited by 8 publications

References 7 publications

Testing the efficacy of three informational interventions for reducing misperceptions of the Black–White wealth gap

Testing the efficacy of three informational interventions for reducing misperceptions of the Black–White wealth gap

Diversity in health care institutions reduces Israeli patients’ prejudice toward Arabs

Missing data in experiments: Challenges and solutions.

Contact Info

Product

Resources

About