Evaluating Foundational Data Quality in the National Patient-Centered Clinical Research Network (PCORnet®)

Abstract

Introduction:Distributed research networks (DRNs) are critical components of the strategic roadmaps for the National Institutes of Health and the Food and Drug Administration as they work to move toward large-scale systems of evidence generation. The National Patient-Centered Clinical Research Network (PCORnet®) is one of the first DRNs to incorporate electronic health record data from multiple domains on a national scale. Before conducting analyses in a DRN, it is important to assess the quality and characteristics of the data.Methods:PCORnet’s Coordinating Center is responsible for evaluating foundational data quality, or assessing fitness-for-use across a broad research portfolio, through a process called data curation. Data curation involves a set of analytic and querying activities to assess data quality coupled with maintenance of detailed documentation and ongoing communication with network partners. The first cycle of PCORnet data curation focused on six domains in the PCORnet common data model: demographics, diagnoses, encounters, enrollment, procedures, and vitals.Results:The data curation process led to improvements in foundational data quality. Notable improvements included the elimination of data model conformance errors; a decrease in implausible height, weight, and blood pressure values; an increase in the volume of diagnoses and procedures; and more complete data for key analytic variables. Based on the findings of the first cycle, we made modifications to the curation process to increase efficiencies and further reduce variation among data partners.Discussion:The iterative nature of the data curation process allows PCORnet to gradually increase the foundational level of data quality and reduce variability across the network. These activities help increase the transparency and reproducibility of analyses within PCORnet and can serve as a model for other DRNs.

Cross-site transportability of an explainable artificial intelligence model for acute kidney injury prediction

“…The clinical data assembled for this study were collected by the Greater Plain Collaborative (GPC), a Patient-Centered Outcome Research Network (PCORnet) Clinical Data Research Network (CDRN) including twelve healthcare systems in nine states 18 . PCORnet developed the CDM to support federated research networks by centering its schema on the patient entity, and enforcing data mapping to controlled vocabularies such as Current Procedural Terminology (CPT), SNOMED CT, Healthcare Common Procedure Coding System (HCPCS), the ICD versions 9 and 10, Logical Observation Identifiers Names and Codes (LOINC), and RxNorm 15 . Using the CDM at all GPC institutions/sites that pass quarterly data quality assessments allows efficient query and analysis execution across different instances of the data model 29 .…”

“…To ensure data harmonization and consistency across health systems, many healthcare institutions have transformed data contained in their EHR into a common representation (terminologies, vocabularies, coding schemes) as well as a common format (common data model or CDM) 15,16 . In 2010, the United States Congress authorized the creation of the non-profit Patient-Centered Outcomes Research Institute (PCORI) who launched PCORnet 17 in 2014 to support the development of an ecosystem for conducting patient-centered outcomes research faster using EHR across hundreds of health systems in the US.…”

Data Science for Child Health

“…Although many CDMs exist, 4 currently dominate large-scale clinical research data-sharing efforts in the United States: i2b2, 21 the virtual data warehouse CDM, 41 the Observational Medical Outcomes Partnership CDM, 42 and the Patient Centered Outcomes Research Network CDM. 43 For example, the multi-institutional PEDSnet CDM 42 is based on the Observational Medical Outcomes Partnership.…”

PCORnet Antibiotics and Childhood Growth Study: Process for Cohort Creation and Cohort Description

“…These included assessments of data model conformance, missing data in required tables and variables, and data plausibility in date and vital measure fields. 7 Required tables included enrollment, encounters, demographics, vital findings, diagnoses, and procedures. The study team additionally required that Network Partners had the capacity to create a pediatric cohort that met the study's inclusion criteria and that could identify antibiotic prescriptions.…”