A multi-class brain tumor grading system based on histopathological images using a hybrid YOLO and RESNET networks

Abstract

Gliomas are primary brain tumors caused by glial cells. These cancers’ classification and grading are crucial for prognosis and treatment planning. Deep learning (DL) can potentially improve the digital pathology investigation of brain tumors. In this paper, we developed a technique for visualizing a predictive tumor grading model on histopathology pictures to help guide doctors by emphasizing characteristics and heterogeneity in forecasts. The proposed technique is a hybrid model based on YOLOv5 and ResNet50. The function of YOLOv5 is to localize and classify the tumor in large histopathological whole slide images (WSIs). The suggested technique incorporates ResNet into the feature extraction of the YOLOv5 framework, and the detection results show that our hybrid network is effective for identifying brain tumors from histopathological images. Next, we estimate the glioma grades using the extreme gradient boosting classifier. The high-dimensional characteristics and nonlinear interactions present in histopathology images are well-handled by this classifier. DL techniques have been used in previous computer-aided diagnosis systems for brain tumor diagnosis. However, by combining the YOLOv5 and ResNet50 architectures into a hybrid model specifically designed for accurate tumor localization and predictive grading within histopathological WSIs, our study presents a new approach that advances the field. By utilizing the advantages of both models, this creative integration goes beyond traditional techniques to produce improved tumor localization accuracy and thorough feature extraction. Additionally, our method ensures stable training dynamics and strong model performance by integrating ResNet50 into the YOLOv5 framework, addressing concerns about gradient explosion. The proposed technique is tested using the cancer genome atlas dataset. During the experiments, our model outperforms the other standard ways on the same dataset. Our results indicate that the proposed hybrid model substantially impacts tumor subtype discrimination between low-grade glioma (LGG) II and LGG III. With 97.2% of accuracy, 97.8% of precision, 98.6% of sensitivity, and the Dice similarity coefficient of 97%, the proposed model performs well in classifying four grades. These results outperform current approaches for identifying LGG from high-grade glioma and provide competitive performance in classifying four categories of glioma in the literature.

Deep Learning Analysis for Predicting Tumor Spread through Air Space in Early-Stage Lung Adenocarcinoma Pathology Images

“…Recent advancements in AI and deep learning have revolutionized medical image analysis, particularly in the detection, segmentation, and classification of tumor tissues in histological images [ 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 ]. Numerous studies have highlighted the efficacy of deep learning models in extracting critical information from routine pathological images, offering valuable clinical insights [ 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 ]. For instance, deep learning has been utilized for quantitative image analysis to forecast disease progression patterns, prognoses, and other clinical outcomes [ 27 , 28 , 29 , 30 , 31 ].…”

“…For example, recent studies have demonstrated the application of deep learning models to various medical imaging tasks, achieving high performance metrics. Elazab et al used a combination of YOLOv5 and ResNet50 for brain tumor detection and classification [ 26 ]. Tsuneki et al used the EfficientNetB1 model in their study on multi-organ adenocarcinoma classification [ 21 ].…”