Evaluation of data completeness in the electronic health record for the purpose of patient recruitment into clinical trials: a retrospective analysis of element presence

Abstract

BackgroundComputerized clinical trial recruitment support is one promising field for the application of routine care data for clinical research. The primary task here is to compare the eligibility criteria defined in trial protocols with patient data contained in the electronic health record (EHR). To avoid the implementation of different patient definitions in multi-site trials, all participating research sites should use similar patient data from the EHR. Knowledge of the EHR data elements which are commonly available from most EHRs is required to be able to define a common set of criteria. The objective of this research is to determine for five tertiary care providers the extent of available data compared with the eligibility criteria of randomly selected clinical trials.MethodsEach participating study site selected three clinical trials at random. All eligibility criteria sentences were broken up into independent patient characteristics, which were then assigned to one of the 27 semantic categories for eligibility criteria developed by Luo et al. We report on the fraction of patient characteristics with corresponding structured data elements in the EHR and on the fraction of patients with available data for these elements. The completeness of EHR data for the purpose of patient recruitment is calculated for each semantic group.Results351 eligibility criteria from 15 clinical trials contained 706 patient characteristics. In average, 55% of these characteristics could be documented in the EHR. Clinical data was available for 64% of all patients, if corresponding data elements were available. The total completeness of EHR data for recruitment purposes is 35%. The best performing semantic groups were ‘age’ (89%), ‘gender’ (89%), ‘addictive behaviour’ (74%), ‘disease, symptom and sign’ (64%) and ‘organ or tissue status’ (61%). No data was available for 6 semantic groups.ConclusionsThere exists a significant gap in structure and content between data documented during patient care and data required for patient eligibility assessment. Nevertheless, EHR data on age and gender of the patient, as well as selected information on his disease can be complete enough to allow for an effective support of the manual screening process with an intelligent preselection of patients and patient data.

Prospective EHR-Based Clinical Trials: The Challenge of Missing Data

“…6 In the Gopalan study, the researchers incorrectly assumed that, due to ADA guidelines, HbA1C would be tested at least once within a 6 month period. 7,8,9 One study has shown a high missing data rate but high accuracy for HbA1C data; 10 and a diabetes RCT has recognized and planned accordingly for missing HbA1C data. 11…”

The completeness of electronic medical record data for patients with Type 2 Diabetes in primary care and its implications for computer modelling of predicted clinical outcomes

“…Data extraction tools that access electronic medical record systems are increasingly being used for quality assurance activities within Australian primary care with recent attention being given to the validity of the information obtained [12,13]. One study has concluded that current tools may be unreliable [12] and recent experience has also raised concerns about the completeness of these data outside of formal research trials [10,14,15].…”

A Comparison of Health Plan- and Provider-Delivered Chronic Care Management Models on Patient Clinical Outcomes

“…32 This suggested that many EHRs may not be ready for clinical research, 33 or that the insurer's administrative data contained spurious diagnoses, 34 or both. We also had to exclude patients who met the inclusion criteria and had a known start date for outreach, but did not have any clinical measures such as HbA 1 c or LDL.…”