Assessment of Clinical Information Quality in Digital Health Technologies: International eDelphi Study

Abstract

Background Digital health technologies (DHTs), such as electronic health records and prescribing systems, are transforming health care delivery around the world. The quality of information in DHTs is key to the quality and safety of care. We developed a novel clinical information quality (CLIQ) framework to assess the quality of clinical information in DHTs. Objective This study explored clinicians’ perspectives on the relevance, definition, and assessment of information quality dimensions in the CLIQ framework. Methods We used a systematic and iterative eDelphi approach to engage clinicians who had information governance roles or personal interest in information governance; the clinicians were recruited through purposive and snowball sampling techniques. Data were collected using semistructured online questionnaires until consensus was reached on the information quality dimensions in the CLIQ framework. Responses on the relevance of the dimensions were summarized to inform decisions on retention of the dimensions according to prespecified rules. Thematic analysis of the free-text responses was used to revise definitions and the assessment of dimensions. Results Thirty-five clinicians from 10 countries participated in the study, which was concluded after the second round. Consensus was reached on all dimensions and categories in the CLIQ framework: informativeness (accuracy, completeness, interpretability, plausibility, provenance, and relevance), availability (accessibility, portability, security, and timeliness), and usability (conformance, consistency, and maintainability). A new dimension, searchability, was introduced in the availability category to account for the ease of finding needed information in the DHTs. Certain dimensions were renamed, and some definitions were rephrased to improve clarity. Conclusions The CLIQ framework reached a high expert consensus and clarity of language relating to the information quality dimensions. The framework can be used by health care managers and institutions as a pragmatic tool for identifying and forestalling information quality problems that could compromise patient safety and quality of care. International Registered Report Identifier (IRRID) RR2-10.1136/bmjopen-2021-057430

Validating a framework to guide the implementation of high-quality virtual primary care: an international eDelphi study protocol

“…The electronic Delphi questionnaire (‘eDelphi’) helps in achieving a good representation and diversity of panel members, saves time and hastens the survey rounds using technology without physical voting24; it has been widely used in healthcare research 25–28…”

Validation of a novel framework to assess clinical information in digital health technologies: structural equation modelling (Preprint)

“…An initial CLIQ framework was developed through a systematic review and qualitative synthesis of existing information quality frameworks for DHTs (Fadahunsi et al, 2021). A CLIQ assessment questionnaire was then developed based on the CLIQ framework and further evidence from literature (Fadahunsi et al, 2022). The questionnaire offers a pragmatic approach to assessing clinical information in DHTs based on relatable clinical scenarios.…”

“…Framework (Fadahunsi et al, 2021, Fadahunsi et al, 2022. The CLIQ framework identifies, defines, and integrates 14 dimensions that are relevant to assessing the clinical information in DHTs (Fadahunsi et al, 2022).…”

“…Framework (Fadahunsi et al, 2021, Fadahunsi et al, 2022. The CLIQ framework identifies, defines, and integrates 14 dimensions that are relevant to assessing the clinical information in DHTs (Fadahunsi et al, 2022). The dimensions in the CLIQ framework are grouped into three categoriesinformativeness, availability and usability.…”

Developing Public Health Surveillance Dashboards: A Scoping Review on the Design Principles

“…Informativeness (accuracy, completeness, interpretability, plausibility, provenance, and relevance), availability (accessibility, portability, security, and timeliness), and usability (conformance, consistency, and maintainability) are key features indicated in these two studies [94,95]. Transparency about data sources and how indicators are calculated are critical for reports' overall quality, credibility, and reliability.…”