Separation of bones from soft tissue in chest radiographs: Anatomy‐specific orientation‐frequency‐specific deep neural network convolution

Abstract

Purpose Lung nodules that are missed by radiologists as well as by computer‐aided detection (CAD) systems mostly overlap with ribs and clavicles. Removing the bony structures would result in better visualization of undetectable lesions. Our purpose in this study was to develop a virtual dual‐energy imaging system to separate ribs and clavicles from soft tissue in chest radiographs. Methods We developed a mixture of anatomy‐specific, orientation‐frequency‐specific (ASOFS) deep neural network convolution (NNC) experts. Anatomy‐specific (AS) NNC was designed to separate the bony structures from soft tissue in different lung segments. While an AS design was proposed previously under our massive‐training artificial neural networks (MTANN) framework, in this work, we newly mathematically defined an AS experts model as well as its learning and inference strategies in a probabilistic deep‐learning framework. In addition, in combination with our AS experts design, we newly proposed the orientation‐frequency‐specific (OFS) NNC models to decompose bone and soft‐tissue structures into specific orientation‐frequency components of different scales using a multi‐resolution decomposition technique. We trained multiple NNC models, each of which is an expert for a specific orientation‐frequency component in a particular anatomic segment. Perfect reconstruction discrete wavelet transform was used for OFS decomposition/reconstruction, while we introduced a soft‐gating layer to merge the predictions of AS NNC experts. To train our model, we used the bone images obtained from a dual‐energy system as the target (or teaching) images while the standard chest radiographs were used as the input to our model. The training, validation, and test were performed in a nested two‐fold cross‐validation manner. Results We used a database of 118 chest radiographs with pulmonary nodules to evaluate our NNC scheme. In order to evaluate our scheme, we performed quantitative and qualitative evaluation of the predicted bone and soft‐tissue images from our model as well as the ones of a state‐of‐the‐art technique where the “gold‐standard” dual‐energy bone and soft‐tissue images were used as the reference images. Both quantitative and qualitative evaluations demonstrated that our ASOFS NNC was superior to the state‐of‐the‐art bone‐suppression technique. Particularly, our scheme was better able to maintain the conspicuity of nodules and lung vessels, comparing to the reference technique, while it separated ribs and clavicles from soft tissue. Comparing to a state‐of‐the‐art bone suppression technique, our bone images had substantially higher (t−test; P < 0.01) similarity, in terms of structural similarity index (SSIM) and peak signal‐to‐noise ratio (PSNR), to the “gold−standard” dual−energy bone images. Conclusions Our deep ASOFS NNC scheme can decompose chest radiographs into their bone and soft‐tissue images accurately, offering the improved conspicuity of lung nodules and vessels, and therefore would be useful for radiologists as well as CAD systems in d...

Bone Suppression on Chest Radiographs for Pulmonary Nodule Detection: Comparison between a Generative Adversarial Network and Dual-Energy Subtraction

“…Software-based bone suppression has been attempted through the delineation and segmentation of ribs and clavicles on CXRs [ 18 24 ]. With recent advances in deep learning, neural-network-based bone suppression algorithms have been developed [ 13 25 26 27 28 ]. These algorithms have been programmed to eliminate bony structures by considering them as noise while preserving soft tissues [ 24 ].…”

“…These algorithms have been programmed to eliminate bony structures by considering them as noise while preserving soft tissues [ 24 ]. However, several issues, such as uneven suppression, image blurring, and unnecessary suppression of soft tissue structures, remain to be solved for practical use [ 19 27 28 ]. In the present study, we used a bone suppression model based on the GAN framework to maintain the similarity between the target and generation domains [ 20 ].…”

Deep learning applications in pulmonary medical imaging: recent updates and insights on COVID-19

“…Bone suppression and separating it from soft tissues are also denoising from a clinical point of view in some cases. For such reason, Zarshenas et al [ 90 ] aimed to develop a model that separates ribs and clavicles from soft tissue to better visualize chest radiographs. The proposed method included CNN of two scopes: anatomy-specific and orientation-specific.…”

Development of Efficient Classification Systems for the Diagnosis of Melanoma

“…Zarshenas et al [7] have discussed the CNN function, which analyzes different lung-related diseases. The most commonly used imaging procedure for determining the lungs is chest eczema-related disorders, yet these techniques are inaccurate.…”