2020
DOI: 10.1371/journal.pone.0229963
|View full text |Cite
|
Sign up to set email alerts
|

Supervised and unsupervised language modelling in Chest X-Ray radiological reports

Abstract: Chest radiography (CXR) is the most commonly used imaging modality and deep neural network (DNN) algorithms have shown promise in effective triage of normal and abnormal radiograms. Typically, DNNs require large quantities of expertly labelled training exemplars, which in clinical contexts is a major bottleneck to effective modelling, as both considerable clinical skill and time is required to produce high-quality ground truths. In this work we evaluate thirteen supervised classifiers using two large free-text… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
2
1

Citation Types

0
22
0

Year Published

2020
2020
2024
2024

Publication Types

Select...
3
3
2

Relationship

0
8

Authors

Journals

citations
Cited by 30 publications
(22 citation statements)
references
References 34 publications
0
22
0
Order By: Relevance
“…More recently, Transformer-based models have also been applied to the task of radiology report labeling. Drozdov et al (2020) trained classifiers using BERT (Devlin et al, 2019) and XLNet (Yang et al, 2020) on 3,856 radiologist labeled reports to detect normal and abnormal labels. Wood et al (2020) developed ALARM, an MRI head report classifier on head MRI data using BioBERT models trained on 1500 radiologist-labeled reports, and demonstrate improvement over simpler fixed embedding and word2vec-based (Mikolov et al, 2013) models (Zech et al, 2018).…”
Section: Related Workmentioning
confidence: 99%
See 1 more Smart Citation
“…More recently, Transformer-based models have also been applied to the task of radiology report labeling. Drozdov et al (2020) trained classifiers using BERT (Devlin et al, 2019) and XLNet (Yang et al, 2020) on 3,856 radiologist labeled reports to detect normal and abnormal labels. Wood et al (2020) developed ALARM, an MRI head report classifier on head MRI data using BioBERT models trained on 1500 radiologist-labeled reports, and demonstrate improvement over simpler fixed embedding and word2vec-based (Mikolov et al, 2013) models (Zech et al, 2018).…”
Section: Related Workmentioning
confidence: 99%
“…More recently, Transformers have demonstrated success in end-to-end radiology report labeling (Drozdov et al, 2020;Wood et al, 2020). However, these methods have shifted the burden from feature engineering to manual annotation, requiring considerable time and expertise for high quality.…”
Section: Introductionmentioning
confidence: 99%
“…Simple approaches have been demonstrated using word embeddings or bag of words feature representations followed by logistic regression [12] or decision trees [13]. More complex approaches using a variety of neural networks have been shown to be effective for document classification by many authors [14,15], especially with the addition of attention mechanisms [3,5,[16][17][18][19]. State-of-the-art solutions use existing pre-trained models, such as Bidirectional Encoder Representations from Transformers (BERT) [4], that have learnt underlying language patterns, and fine-tune them on small domain-specific datasets.…”
Section: Radiology Report Labellingmentioning
confidence: 99%
“…Chen et al applied CNNs to classify pulmonary embolism in chest CT reports (Chen et al, 2018). Drozdov et al compared thirteen supervised classifiers and demonstrate that bidirectional long short-term memory (BiLSTM) networks with attention mechanisms effectively identify labels in CXR reports (Drozdov et al, 2020). Wood et al present a transformer-based network for brain magnetic resonance imaging (MRI) radiology report classification, which automates this task by assigning image labels based on free-text expert radiology reports (Wood et al, 2020).…”
Section: Related Workmentioning
confidence: 99%