What Influences the Way Radiologists Express Themselves in Their Reports? A Quantitative Assessment Using Natural Language Processing

Abstract

Although using standardized reports is encouraged, most emergency radiological reports in France remain in free-text format that can be mined with natural language processing for epidemiological purposes, activity monitoring or data collection. These reports are obtained under various on-call conditions by radiologists with various backgrounds. Our aim was to investigate what influences the radiologists’ written expressions. To do so, this retrospective multicentric study included 30,227 emergency radiological reports of computed tomography scans and magnetic resonance imaging involving exactly one body region, only with pathological findings, interpreted from 2019–09-01 to 2020–02-28 by 165 radiologists. After text pre-processing, one-word tokenization and use of dictionaries for stop words, polarity, sentiment and uncertainty, 11 variables depicting the structure and content of words and sentences in the reports were extracted and summarized to 3 principal components capturing 93.7% of the dataset variance. In multivariate analysis, the 1 st principal component summarized the length and lexical diversity of the reports and was significantly influenced by the weekday, time slot, workload, number of examinations previously interpreted by the radiologist during the on-call period, type of examination, emergency level and radiologists’ gender ( P value range: < 0.0001–0.0029). The 2 nd principal component summarized negative formulations, polarity and sentence length and was correlated with the number of examination previously interpreted by the radiologist, type of examination, emergency level, imaging modality and radiologists’ experience ( P value range: < 0.0001–0.0032). The last principal component summarized questioning, uncertainty and polarity and was correlated with the type of examination and emergency level (all P values < 0.0001). Thus, the length, structure and content of emergency radiological reports were significantly influenced by organizational, radiologist- and examination-related characteristics, highlighting the subjectivity and variability in the way radiologists express themselves during their clinical activity. These findings advocate for more homogeneous practices in radiological reporting and stress the need to consider these influential features when developing models based on natural language processing. Supplementary Information The online version contains supplementary material available at 10.1007/s10278-022-00619-6.

Degree of Uncertainty in Reporting Imaging Findings for Necrotizing Enterocolitis: A Secondary Analysis from a Pilot Randomized Diagnostic Trial

“…While substantial variability in the use of uncertainty terms was observed, the degree of variability could not be explained by differences in years of experience of radiologists. Similar results were observed by Crombe et al [ 32 ] in a multicenter study of over 30,000 computed topography scans and magnetic resonance imaging interpreted by 165 radiologists. Despite having a smaller sample size, our study mirrors the findings of these studies in demonstrating no correlation between the use of uncertain language on imaging reports and the experience of the interpreting radiologist.…”

Using the Textual Content of Radiological Reports to Detect Emerging Diseases: A Proof-of-Concept Study of COVID-19

“…Using natural language processing (NLP) to label reports could help generate large cohorts, plan human and technical resources, assess compliance with guidelines, and detect discrepancies between results and conclusions [ 1 – 3 ]. It has been recently shown that the structure and content of reports developed by emergency radiologists depend on their personal background, examination characteristics, or workload [ 4 ]. On a clinical side, one could hypothesize that an emerging new disease with significant impact on health would lead to new patterns of radiological depictions that could be captured with NLP before the semiology of the disease has been deciphered, which is inherently shifted by several weeks due to the time needed to understand patterns, collect databases, and statistically verify associations between features and diseases.…”