Considerations for Observational Research Using Large Data Sets in Radiation Oncology

Abstract

The radiation oncology community has witnessed growing interest in observational research conducted using large-scale data sources such as registries and claims-based datasets. With the growing emphasis on observational analyses in health care, the radiation oncology community must possess a sophisticated understanding of the methodological considerations of such studies in order to evaluate evidence appropriately to guide practice and policy. Because observational research has unique features that distinguish it from clinical trials and other forms of traditional radiation oncology research, the Red Journal assembled a panel of experts in health services research to provide a concise and well-referenced review, intended to be informative for the lay reader, as well as for scholars who wish to embark on such research without prior experience. This review begins by discussing the types of research questions relevant to radiation oncology that large-scale databases may help illuminate. It then describes major potential data sources for such endeavors, including information regarding access and insights regarding the strengths and limitations of each. Finally, it provides guidance regarding the analytic challenges that observational studies must confront, along with discussion of the techniques that have been developed to help minimize the impact of certain common analytical issues in observational analysis. Features characterizing a well-designed observational study include clearly defined research questions, careful selection of an appropriate data source, consultation with investigators with relevant methodological expertise, inclusion of sensitivity analyses, caution not to overinterpret small but significant differences, and recognition of limitations when trying to evaluate causality. This review concludes that carefully designed and executed studies using observational data that possess these qualities hold substantial promise for advancing our understanding of many unanswered questions of importance to the field of radiation oncology.

Survival outcomes in patients with gastric and gastroesophageal junction adenocarcinomas treated with perioperative chemotherapy with or without preoperative radiotherapy

“…Last, PSM minimizes bias by balancing confounders based on observed characteristics. It does not eliminate the possibility that outcomes are influenced by unobserved, and thus potentially unbalanced, covariates …”

Factors Predictive of Receiving Adjuvant Radiotherapy in High-Intermediate–Risk Stage I Endometrial Cancer

“…Another weakness of the NCDB is that it is not population based but hospital based, taken from the institutions where patients present for diagnosis and management, thus hampering the generalizability of NCDB cohorts, all of whom are patients treated at accredited hospitalsVpresenting a potential selection bias for higher-quality patient care and outcomes. 16 In conclusion, this hospital-based retrospective analysis of patterns of care in stage I HIR EC demonstrates variability in how consistently adjuvant RT is given to these patients. The National Comprehensive Cancer Network guidelines allow for observation in such patients because local recurrences can be salvaged and because randomized trials have yet to show any overall survival benefit.…”

The opportunities and shortcomings of using big data and national databases for sarcoma research

“…There are many warnings cited in the 11,13,16,17 For example, a study in 2014 on International Classification of Diseases, Ninth Revision (ICD-9) codes for patients undergoing lumbar fusions showed that 48% of the cases did not have a primary diagnosis code to reflect the primary indication for surgery. There are many warnings cited in the 11,13,16,17 For example, a study in 2014 on International Classification of Diseases, Ninth Revision (ICD-9) codes for patients undergoing lumbar fusions showed that 48% of the cases did not have a primary diagnosis code to reflect the primary indication for surgery.…”