A four-step strategy for handling missing outcome data in randomised trials affected by a pandemic

Abstract

Background: The coronavirus pandemic (Covid-19) presents a variety of challenges for ongoing clinical trials, including an inevitably higher rate of missing outcome data, with new and non-standard reasons for missingness. International drug trial guidelines recommend trialists review plans for handling missing data in the conduct and statistical analysis, but clear recommendations are lacking.Methods: We present a four-step strategy for handling missing outcome data in the analysis of randomised trials that are ongoing during a pandemic. We consider handling missing data arising due to (i) participant infection, (ii) treatment disruptions and (iii) loss to follow-up. We consider both settings where treatment effects for a ‘pandemic-free world’ and ‘world including a pandemic’ are of interest. Results: In any trial, investigators should; (1) Clarify the treatment estimand of interest with respect to the occurrence of the pandemic; (2) Establish what data are missing for the chosen estimand; (3) Perform primary analysis under the most plausible missing data assumptions followed by; (4) Sensitivity analysis under alternative plausible assumptions. To obtain an estimate of the treatment effect in a ‘pandemic-free world’, participant data that are clinically affected by the pandemic (directly due to infection or indirectly via treatment disruptions) are not relevant and can be set to missing. For primary analysis, a missing-at-random assumption that conditions on all observed data that are expected to be associated with both the outcome and missingness may be most plausible. For the treatment effect in the ‘world including a pandemic’, all participant data is relevant and should be included in the analysis. For primary analysis, a missing-at-random assumption – potentially incorporating a pandemic time-period indicator and participant infection status – or a missing-not-at-random assumption with a poorer response may be most relevant, depending on the setting. In all scenarios, sensitivity analysis under credible missing-not-at-random assumptions should be used to evaluate the robustness of results. We highlight controlled multiple imputation as an accessible tool for conducting sensitivity analyses.Conclusions: Missing data problems will be exacerbated for trials active during the Covid-19 pandemic. This four-step strategy will facilitate clear thinking about the appropriate analysis for relevant questions of interest.

Coronavirus Disease 2019: Considerations for Health Technology Assessment From the National Centre for Pharmacoeconomics Review Group

“…Among others, the European Medicines Agency 2 and the U.S. Food and Drug Administration 3 have developed guidance for handling deviations to the trial protocol. Cro et al 4 and Meyer et al 5 also discuss statistical issues and missing data arising in trials conducted during the COVID-19 pandemic. Nevertheless, there are additional issues that will affect HTA, over and above those considered by regulators.…”

Application of the Estimand Framework to Anesthesia Trials

“…23 The estimand framework guides the handling of missing data and provides clarity on differentiating between missing data and data affected by intercurrent events. 1,24,25 The ICH guidelines also discuss the importance of conducting sensitivity and supplementary analyses. In sensitivity analyses, the estimand(s), including strategies for handling intercurrent events, remain unchanged from the primary analysis but vary in terms of the underlying assumptions of the statistical analysis models.…”

Exercise therapy and patient education versus intra-articular saline injections in the treatment of knee osteoarthritis: an evidence-based protocol for an open-label randomised controlled trial (the DISCO trial)

“…The COVID-19 pandemic and associated restrictions may have affected the participants both directly and indirectly [38,39]. While the trial suspension was relatively short-lived, the impact of the pandemic will likely continue after the restart of the trial.…”