The growing amount of data in operational electronic health record (EHR) systems provides unprecedented opportunity for its re-use for many tasks, including comparative effectiveness research (CER). However, there are many caveats to the use of such data. EHR data from clinical settings may be inaccurate, incomplete, transformed in ways that undermine their meaning, unrecoverable for research, of unknown provenance, of insufficient granularity, and incompatible with research protocols. However, the quantity and real-world nature of these data provide impetus for their use, and we develop a list of caveats to inform would-be users of such data as well as provide an informatics roadmap that aims to insure this opportunity to augment CER can be best leveraged.

Purpose We describe the design, implementation, and use of a large, multiorganizational distributed database developed to support the Mini-Sentinel Pilot Program of the US Food and Drug Administration (FDA). As envisioned by the US FDA, this implementation will inform and facilitate the development of an active surveillance system for monitoring the safety of medical products (drugs, biologics, and devices) in the USA. Methods A common data model was designed to address the priorities of the Mini-Sentinel Pilot and to leverage the experience and data of participating organizations and data partners. A review of existing common data models informed the process. Each participating organization designed a process to extract, transform, and load its source data, applying the common data model to create the Mini-Sentinel Distributed Database. Transformed data were characterized and evaluated using a series of programs developed centrally and executed locally by participating organizations. A secure communications portal was designed to facilitate queries of the Mini-Sentinel Distributed Database and transfer of confidential data, analytic tools were developed to facilitate rapid response to common questions, and distributed querying software was implemented to facilitate rapid querying of summary data. Results As of July 2011, information on 99 260 976 health plan members was included in the Mini-Sentinel Distributed Database. The database includes 316 009 067 person-years of observation time, with members contributing, on average, 27.0 months of observation time. All data partners have successfully executed distributed code and returned findings to the Mini-Sentinel Operations Center. Conclusion This work demonstrates the feasibility of building a large, multiorganizational distributed data system in which organizations retain possession of their data that are used in an active surveillance system.

The Mini-Sentinel is a pilot program that is developing methods, tools, resources, policies, and procedures to facilitate the use of routinely collected electronic healthcare data to perform active surveillance of the safety of marketed medical products, including drugs, biologics, and medical devices. The U.S. After two years, Mini-Sentinel includes 31 academic and private organizations. It has developed policies, procedures, and technical specifications for developing and operating a secure distributed data system comprised of separate data sets that conform to a common data model covering enrollment, demographics, encounters, diagnoses, procedures, and ambulatory dispensing of prescription drugs. The distributed data sets currently include administrative and claims data from 2000 to 2011 for over 300 million person-years, 2.4 billion encounters, 38 million inpatient hospitalizations, and 2.9 billion dispensings. Selected laboratory results and vital signs data recorded after 2005 are also available. There is an active data quality assessment and characterization program, and eligibility for medical care and pharmacy benefits is known. Systematic reviews of the literature have assessed the ability of administrative data to identify health outcomes of interest, and procedures have been developed and tested to obtain, abstract, and adjudicate full-text medical records to validate coded diagnoses. Mini-Sentinel has also created a taxonomy of study designs and analytical approaches for many commonly occurring situations, and it is developing new statistical and epidemiologic methods to address certain gaps in analytic capabilities.Assessments are performed by distributing computer programs that are executed locally by each data partner. The system is in active use by FDA, with the majority of assessments performed using customizable, reusable queries (programs). Prospective and retrospective assessments that use customized protocols are conducted as well. To date, several hundred unique programs have been distributed and executed.Current activities include active surveillance of several drugs and vaccines, expansion of the population, enhancement of the common data model to include additional types of data from electronic health records and registries, development of new methodologic capabilities, and assessment of methods to identify and validate additional health outcomes of interest.

ImportanceSARS-CoV-2 infection is associated with persistent, relapsing, or new symptoms or other health effects occurring after acute infection, termed postacute sequelae of SARS-CoV-2 infection (PASC), also known as long COVID. Characterizing PASC requires analysis of prospectively and uniformly collected data from diverse uninfected and infected individuals.ObjectiveTo develop a definition of PASC using self-reported symptoms and describe PASC frequencies across cohorts, vaccination status, and number of infections.Design, Setting, and ParticipantsProspective observational cohort study of adults with and without SARS-CoV-2 infection at 85 enrolling sites (hospitals, health centers, community organizations) located in 33 states plus Washington, DC, and Puerto Rico. Participants who were enrolled in the RECOVER adult cohort before April 10, 2023, completed a symptom survey 6 months or more after acute symptom onset or test date. Selection included population-based, volunteer, and convenience sampling.ExposureSARS-CoV-2 infection.Main Outcomes and MeasuresPASC and 44 participant-reported symptoms (with severity thresholds).ResultsA total of 9764 participants (89% SARS-CoV-2 infected; 71% female; 16% Hispanic/Latino; 15% non-Hispanic Black; median age, 47 years [IQR, 35-60]) met selection criteria. Adjusted odds ratios were 1.5 or greater (infected vs uninfected participants) for 37 symptoms. Symptoms contributing to PASC score included postexertional malaise, fatigue, brain fog, dizziness, gastrointestinal symptoms, palpitations, changes in sexual desire or capacity, loss of or change in smell or taste, thirst, chronic cough, chest pain, and abnormal movements. Among 2231 participants first infected on or after December 1, 2021, and enrolled within 30 days of infection, 224 (10% [95% CI, 8.8%-11%]) were PASC positive at 6 months.Conclusions and RelevanceA definition of PASC was developed based on symptoms in a prospective cohort study. As a first step to providing a framework for other investigations, iterative refinement that further incorporates other clinical features is needed to support actionable definitions of PASC.

IMPORTANCE Financial incentives to physicians or patients are increasingly used, but their effectiveness is not well established. OBJECTIVE To determine whether physician financial incentives, patient incentives, or shared physician and patient incentives are more effective than control in reducing levels of low-density lipoprotein cholesterol (LDL-C) among patients with high cardiovascular risk. DESIGN, SETTING, AND PARTICIPANTS Four-group, multicenter, cluster randomized clinical trial with a 12-month intervention conducted from 2011 to 2014 in 3 primary care practices in the northeastern United States. Three hundred forty eligible primary care physicians (PCPs) were enrolled from a pool of 421. Of 25 627 potentially eligible patients of those PCPs, 1503 enrolled. Patients aged 18 to 80 years were eligible if they had a 10-year Framingham Risk Score (FRS) of 20% or greater, had coronary artery disease equivalents with LDL-C levels of 120 mg/dL or greater, or had an FRS of 10% to 20% with LDL-C levels of 140 mg/dL or greater. Investigators were blinded to study group, but participants were not. INTERVENTIONS Primary care physicians were randomly assigned to control, physician incentives, patient incentives, or shared physician-patient incentives. Physicians in the physician incentives group were eligible to receive up to $1024 per enrolled patient meeting LDL-C goals. Patients in the patient incentives group were eligible for the same amount, distributed through daily lotteries tied to medication adherence. Physicians and patients in the shared incentives group shared these incentives. Physicians and patients in the control group received no incentives tied to outcomes, but all patient participants received up to $355 each for trial participation. MAIN OUTCOMES AND MEASURES Change in LDL-C level at 12 months. RESULTS Only patients in the shared physician-patient incentives group achieved reductions in LDL-C levels statistically different from those in the control group (8.5 mg/dL; 95% CI, 3.8–13.3; P = .002). For comparison of all 4 groups, P < .001. Low-Density LipoproteinCholesterol LevelIncentives Group SharedPhysicianPatientControlMean reduction (95% CI), mg/dL33.6 (30.1–37.1)27.9 (24.9–31.0)25.1 (21.6–28.5)25.1 (21.7–28.5)Baseline, mg/dL160.1159.9160.6161.512 Months, mg/dL126.4132135.5136.4 CONCLUSIONS AND RELEVANCE In primary care practices, shared financial incentives for physicians and patients, but not incentives to physicians or patients alone, resulted in a statistically significant difference in reduction of LDL-C levels at 12 months. This reduction was modest, however, and further information is needed to understand whether this approach represents good value. TRIAL REGISTRATION clinicaltrials.gov Identifier: NCT01346189