From patient care to research: a validation study examining the factors contributing to data quality in a primary care electronic medical record database

Abstract

BackgroundElectronic Medical Records (EMRs) are increasingly used in the provision of primary care and have been compiled into databases which can be utilized for surveillance, research and informing practice. The primary purpose of these records is for the provision of individual patient care; validation and examination of underlying limitations is crucial for use for research and data quality improvement. This study examines and describes the validity of chronic disease case definition algorithms and factors affecting data quality in a primary care EMR database.MethodsA retrospective chart audit of an age stratified random sample was used to validate and examine diagnostic algorithms applied to EMR data from the Manitoba Primary Care Research Network (MaPCReN), part of the Canadian Primary Care Sentinel Surveillance Network (CPCSSN). The presence of diabetes, hypertension, depression, osteoarthritis and chronic obstructive pulmonary disease (COPD) was determined by review of the medical record and compared to algorithm identified cases to identify discrepancies and describe the underlying contributing factors.ResultsThe algorithm for diabetes had high sensitivity, specificity and positive predictive value (PPV) with all scores being over 90%. Specificities of the algorithms were greater than 90% for all conditions except for hypertension at 79.2%. The largest deficits in algorithm performance included poor PPV for COPD at 36.7% and limited sensitivity for COPD, depression and osteoarthritis at 72.0%, 73.3% and 63.2% respectively. Main sources of discrepancy included missing coding, alternative coding, inappropriate diagnosis detection based on medications used for alternate indications, inappropriate exclusion due to comorbidity and loss of data.ConclusionsComparison to medical chart review shows that at MaPCReN the CPCSSN case finding algorithms are valid with a few limitations. This study provides the basis for the validated data to be utilized for research and informs users of its limitations. Analysis of underlying discrepancies provides the ability to improve algorithm performance and facilitate improved data quality.

The unclosing premature mortality gap in gout: a general population-based study

“…However, uncertainty surrounding diagnostic accuracy is a potential concern in epidemiological studies such as ours. Nevertheless, the overall accuracy of using EMRs to assess important outcomes appears to be high as reflected in many validation studies 47 48. Furthermore, no other significant difference over the two periods was evident using our more specific alternative definition (ie, a physician-recorded diagnosis of gout plus at least one prescription of antigout medication, which has a positive predictive value of 90%) 17 49.…”

Can Electronic Health Records Be Used for Population Health Surveillance? Validating Population Health Metrics Against Established Survey Data

“…Since CHS did not include the PHQ 9, the NYC Macroscope depression indicator was also evaluated against NYC HANES and CHS measures of self-reported depression diagnosis alone. We did not formally evaluate a depression measure that included medication for depression because those medications are often prescribed to treat other conditions 19,20…”

Prevalence of toddler, child and adolescent overweight and obesity derived from primary care electronic medical records: an observational study

“…The recording of primary care EMR data continues to suffer entry error and can be absent or unavailable for use. [27][28][29] Missing measurements for length, height and weight and data standardization are variable across clinics and EMRs, as well as within the same EMR. 30,31 Our study population was limited to patients who visit their primary care providers.…”