Purpose To evaluate the validity of health plan and birth certificate data for pregnancy research. Methods A retrospective study was conducted using administrative and claims data from 11 U.S. health plans, and corresponding birth certificate data from state health departments. Diagnoses, drug dispensings, and procedure codes were used to identify infant outcomes (cardiac defects, anencephaly, preterm birth, and neonatal intensive care unit [NICU] admission) and maternal diagnoses (asthma and systemic lupus erythematosus [SLE]) recorded in the health plan data for live born deliveries between January 2001 and December 2007. A random sample of medical charts (n = 802) was abstracted for infants and mothers identified with the specified outcomes. Information on newborn, maternal, and paternal characteristics (gestational age at birth, birth weight, previous pregnancies and live births, race/ethnicity) was also abstracted and compared to birth certificate data. Positive predictive values (PPVs) were calculated with documentation in the medical chart serving as the gold standard. Results PPVs were 71% for cardiac defects, 37% for anencephaly, 87% for preterm birth, and 92% for NICU admission. PPVs for algorithms to identify maternal diagnoses of asthma and SLE were ≥ 93%. Our findings indicated considerable agreement (PPVs > 90%) between birth certificate and medical record data for measures related to birth weight, gestational age, prior obstetrical history, and race/ethnicity. Conclusions Health plan and birth certificate data can be useful to accurately identify some infant outcomes, maternal diagnoses, and newborn, maternal, and paternal characteristics. Other outcomes and variables may require medical record review for validation.

Background: Gaps in disease surveillance capacity, particularly for emerging infections and bioterrorist attack, highlight a need for efficient, real time identification of diseases.