A Comparison of Clinical Registry Versus Administrative Claims Data for Reporting of 30-Day Surgical Complications

Abstract

Objectives:To compare the recording of 30-day postoperative complications between a national clinical registry and Medicare inpatient claims data and to determine whether the addition of outpatient claims data improves concordance with the clinical registry. Background: Policymakers are increasingly discussing use of postoperative complication rates for value-based purchasing. There is debate regarding the optimal data source for such measures. Methods: Patient records (2005)(2006)(2007)(2008) from the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) were linked to Medicare inpatient and outpatient claims data sets. We assessed the ability of (1) Medicare inpatient claims and (2) Medicare inpatient and outpatient claims to detect a core set of ACS-NSQIP 30-day postoperative complications: superficial surgical site infection (SSI), deep/organ-space SSI, any SSI (superficial and/or deep/organ-space), urinary tract infection, pneumonia, sepsis, deep venous thrombosis (DVT), pulmonary embolism, venous thromboembolism (DVT and/or pulmonary embolism), and myocardial infarction. Agreement of patient-level complications by ACS-NSQIP versus Medicare was assessed by κ statistics. Results: A total of 117,752 patients from more than 200 hospitals were studied. The sensitivity of inpatient claims data for detecting ACS-NSQIP complications ranged from 0.27 to 0.78; the percentage of false-positives ranged from 48% to 84%. Addition of outpatient claims data improved sensitivity slightly but also greatly increased the percentage of false-positives. Agreement was routinely poor between clinical and claims data for patient-level complications.Conclusions: This analysis demonstrates important differences between ACS-NSQIP and Medicare claims data sets for measuring surgical complications. Poor accuracy potentially makes claims data suboptimal for evaluating surgical complications. These findings have meaningful implications for performance measures currently being considered.From the

Obesity is Not Associated with Increased Short-term Complications After Primary Total Shoulder Arthroplasty

“…The accuracy of documentation of clinical diagnoses, comorbidities, and complications collected in any database can be limited by errors in data entry. However, previous studies of the ACS-NSQIP 1 database have shown excellent accuracy and quality control because the database relies on clinical data from patients' medical charts gathered by skilled reviewers and does not rely on administrative claims or billing information [9,10,15,20]. The integrity of data collected is scrutinized through site visits at participating institutions, conference calls, an annual meeting of participants, and regular auditing.…”

The prevalence of perioperative complications in patients with and without obstructive sleep apnoea: a prospective cohort study

“…Postoperative complications contribute significantly to the risks of surgery and anaesthesia, with impact on discharge and financial repercussions on the health system [19]. The risk of perioperative complications depends on ASA (American Society of Anesthesiologists) class [20], age [21], emergency surgery, cardiac comorbidities [22], smoking [23], duration of surgery [24], type of anaesthesia [25], as well as on the presence of comorbidities such as chronic obstructive pulmonary disease, coronary artery disease, and renal failure [26].…”

Risk-Adjusted Hospital Outcomes for Children’s Surgery

“…10 This program has incorporated a wide range of surgical specialties and pediatric-specific comorbidities, procedures, and outcomes. In contrast to claims databases that rely on billing or administrative codes with potentially inconsistent clinical meaning, [11][12][13] the NSQIPPediatric utilizes trained personnel to prospectively collect comprehensive clinical data from the medical record. After establishing feasibility, 8,9 the NSQIP-Pediatric rapidly expanded to include more than 40 hospitals.…”