Making sense of the shadows: priorities for creating a learning healthcare system based on routinely collected data

Abstract

Socrates described a group of people chained up inside a cave, who mistook shadows of objects on a wall for reality. This allegory comes to mind when considering ‘routinely collected data’—the massive data sets, generated as part of the routine operation of the modern healthcare service. There is keen interest in routine data and the seemingly comprehensive view of healthcare they offer, and we outline a number of examples in which they were used successfully, including the Birmingham OwnHealth study, in which routine data were used with matched control groups to assess the effect of telephone health coaching on hospital utilisation.Routine data differ from data collected primarily for the purposes of research, and this means that analysts cannot assume that they provide the full or accurate clinical picture, let alone a full description of the health of the population. We show that major methodological challenges in using routine data arise from the difficulty of understanding the gap between patient and their ‘data shadow’. Strategies to overcome this challenge include more extensive data linkage, developing analytical methods and collecting more data on a routine basis, including from the patient while away from the clinic. In addition, creating a learning health system will require greater alignment between the analysis and the decisions that will be taken; between analysts and people interested in quality improvement; and between the analysis undertaken and public attitudes regarding appropriate use of data.

Quality and safety between ward and board: a biography of artefacts study

“…That said, few authors talk in any detail about data or information systems. 8,9 The 2013 report by Donald Berwick, the respected US physician, is one of the exceptions to the general rule. He identified a range of routine data that ward staff -and wider clinical teams -needed to investigate unwarranted variations in services and to support service improvement ( Table 1).…”

Responsiveness, Reliability, and Minimally Important and Minimal Detectable Changes of 3 Electronic Patient-Reported Outcome Measures for Low Back Pain: Validation Study (Preprint)

“…More generally, routine outcome measurement in clinical practice will permit learning healthcare systems and so should be a shared goal by stakeholders across healthcare. [86] To achieve this, greater collaboration may be needed between clinicians, informatics, and policy makers. We also encourage further metric testing of electronic versions these and other legacy PROMs as so that results may inform health services researchers' and clinicians' choices of measure.…”

Defining next generation medicine for the patient through translational care: big data scientist training enhancement program (BD-STEP)

“…Thus, reuse of EMR data in a learning health system (LHS) requires deep understanding of the purpose of the analysis and the decision making that will result. This requires ongoing collaborations between data analysts and stakeholders who use the results of the analyses with special attention paid to considerations such as public attitudes regarding appropriate use of data [7]. If successfully implemented in oncology, for example, a LHS can provide opportunity to rapidly learn the value/cost tradeoff of tumor mutation detection to advance our understanding of the value of a Precision Oncology Program [8].…”