A computational framework for converting textual clinical diagnostic criteria into the quality data model

Abstract

Background Constructing standard and computable clinical diagnostic criteria is an important but challenging research field in the clinical informatics community. The Quality Data Model (QDM) is emerging as a promising information model for standardizing clinical diagnostic criteria. Objective To develop and evaluate automated methods for converting textual clinical diagnostic criteria in a structured format using QDM. Methods We used a clinical Natural Language Processing (NLP) tool known as cTAKES to detect sentences and annotate events in diagnostic criteria. We developed a rule-based approach for assigning the QDM datatype(s) to an individual criterion, whereas we invoked a machine learning algorithm based on the Conditional Random Fields (CRFs) for annotating attributes belonging to each particular QDM datatype. We manually developed an annotated corpus as the gold standard and used standard measures (precision, recall and f-measure) for the performance evaluation. Results We harvested 267 individual criteria with the datatypes of Symptom and Laboratory Test from 63 textual diagnostic criteria. We manually annotated attributes and values in 142 individual Laboratory Test criteria. The average performance of our rule-based approach was 0.84 of precision, 0.86 of recall, and 0.85 of f-measure; the performance of CRFs-based classification was 0.95 of precision, 0.88 of recall and 0.91 of f-measure. We also implemented a web-based tool that automatically translates textual Laboratory Test criteria into the QDM XML template format. The results indicated that our approaches leveraging cTAKES and CRFs are effective in facilitating diagnostic criteria annotation and classification. Conclusion Our NLP-based computational framework is a feasible and useful solution in developing diagnostic criteria representation and computerization.

How Artificial Intelligence Can Improve Our Understanding of the Genes Associated with Endometriosis: Natural Language Processing of the PubMed Database

“…The database was searched with the keywords “endometriosis and genes” and “endometriosis and genetic”. The relevant publications were retrieved in extensible markup language (XML) format in order to make the information extraction more precise, with content enclosed within XML tag pairs [ 19 ]. The titles and abstracts of each article were converted into the PubTator format [ 20 ] through a custom Perl script.…”

Data Harmonization for Heterogeneous Datasets: A Systematic Literature Review

“…The overall performance of this system is measured in precision, recall, and F-Score. In addition, the same authors, Hong et al [59] proposed a model for the quality and performance-based data integration for information extraction, using NLP, ML, and Bag of Words (BoW). Moreover, Hong et al [60] used a Mayo Clinic dataset with the help of NLP toolkits for making a digital FHIR system.…”

“…[57] Healthcare Helps in patient-lefted care decision-making among stakeholders [58] Healthcare Helps in finding the patient having obesity and comorbidities [59] Healthcare Helps in developing patient diagnostic criteria and representation [61] General-Purpose Support in integration, storage, computation, and visualization [62] Healthcare Open biomedical repositories can be developed in semantic web formats [60] Healthcare Normalizing and integration of structured and unstructured EHR data [63] Healthcare Helps health information system to keep a record of patients' data [64] Healthcare Helps in standardizing the clinical data normalization In previous studies, SSU heterogeneous data were used in the form of text, images, audio, video, and social media formats. The BD and BDA literature reviews proposed so many models and frameworks for data harmonization or integration.…”