Combined model integrating deep learning, radiomics, and clinical data to classify lung nodules at chest CT

Abstract

Objectives The study aimed to develop a combined model that integrates deep learning (DL), radiomics, and clinical data to classify lung nodules into benign or malignant categories, and to further classify lung nodules into different pathological subtypes and Lung Imaging Reporting and Data System (Lung-RADS) scores. Materials and methods The proposed model was trained, validated, and tested using three datasets: one public dataset, the Lung Nodule Analysis 2016 (LUNA16) Grand challenge dataset (n = 1004), and two private datasets, the Lung Nodule Received Operation (LNOP) dataset (n = 1027) and the Lung Nodule in Health Examination (LNHE) dataset (n = 1525). The proposed model used a stacked ensemble model by employing a machine learning (ML) approach with an AutoGluon-Tabular classifier. The input variables were modified 3D convolutional neural network (CNN) features, radiomics features, and clinical features. Three classification tasks were performed: Task 1: Classification of lung nodules into benign or malignant in the LUNA16 dataset; Task 2: Classification of lung nodules into different pathological subtypes; and Task 3: Classification of Lung-RADS score. Classification performance was determined based on accuracy, recall, precision, and F1-score. Ten-fold cross-validation was applied to each task. Results The proposed model achieved high accuracy in classifying lung nodules into benign or malignant categories in LUNA 16 with an accuracy of 92.8%, as well as in classifying lung nodules into different pathological subtypes with an F1-score of 75.5% and Lung-RADS scores with an F1-score of 80.4%. Conclusion Our proposed model provides an accurate classification of lung nodules based on the benign/malignant, different pathological subtypes, and Lung-RADS system.

Computer-aided diagnostic system with automated deep learning method based on the AutoGluon framework improved the diagnostic accuracy of early esophageal cancer

“…Amazon has developed AutoGluon, an open-source code library for automatic machine learning that enables developers to build machine learning applications incorporating image, text, or tabular datasets. Compared with other machine learning programs, AutoGluon boasts the advantages of user-friendliness, scalability, and high accuracy ( 24 - 26 ). At present, good application effects have been achieved in multiple medically-related fields, such as the design and development of new drugs, government medical policy formulation, and more commonly assisting clinical physicians in evaluating patient prognosis and formulating appropriate diagnosis and treatment plans ( 27 - 29 ).…”

An Informative Review of Radiomics Studies on Cancer Imaging: The Main Findings, Challenges and Limitations of the Methodologies

“…This is critical not only by a medico-legal point of view, but also by a "human" point of view, because, like Coppola et al [81] stressed, we must not superintend the meaning of the irreplaceable doctor-patient bond. Connecting doctors and patients directly will always be an important phase of healthcare services that artificial intelligence can never replace [2,20,68,[102][103][104][105][106][107][108][109].…”

A Multichannel CT and Radiomics-Guided CNN-ViT (RadCT-CNNViT) Ensemble Network for Diagnosis of Pulmonary Sarcoidosis

“…For example, radiomic features were extracted from CT image and used in a deep learning network, which is an example of early fusion, and then further combined with clinical features at a late stage for the prediction of the EGFR gene mutation status for non-small cell lung carcinoma [39]. Similarly, radiomics features were extracted separately and then combined with features derived from CNN and fused at an intermediate stage before the classification of COPD staging [40] and lung nodule classification [28,41]. All methods that extracted radiomic features, however, depended on defining a region of interest, except in Liang et al [42], where radiomics features were extracted from the entire lung, although the lung parenchyma was segmented.…”