Deep Gaussian Processes for Classification With Multiple Noisy Annotators. Application to Breast Cancer Tissue Classification

Abstract

Machine learning (ML) methods often require large volumes of labeled data to achieve meaningful performance. The expertise necessary for labeling data in medical applications like pathology presents a significant challenge in developing clinical-grade tools. Crowdsourcing approaches address this challenge by collecting labels from multiple annotators with varying degrees of expertise. In recent years, multiple methods have been adapted to learn from noisy crowdsourced labels. Among them, Gaussian Processes (GPs) have achieved excellent performance due to their ability to model uncertainty. Deep Gaussian Processes (DGPs) address the limitations of GPs using multiple layers to enable the learning of more complex representations. In this work, we develop Deep Gaussian Processes for Crowdsourcing (DGPCR) to model the crowdsourcing problem with DGPs for the first time. DGPCR models the (unknown) underlying true labels, and the behavior of each annotator is modeled with a confusion matrix among classes. We use end-to-end variational inference to estimate both DGPCR parameters and annotator biases. Using annotations from 25 pathologists and medical trainees, we show that DGPCR is competitive or superior to Scalable Gaussian Processes for Crowdsourcing (SVGPCR) and other state-of-the-art deep-learning crowdsourcing methods for breast cancer classification. Also, we observe that DGPCR with noisy labels obtains better results (F1 = 81.91%) than GPs (F1 = 81.57%) and deep learning methods (F1 = 80.88%) with true labels curated by experts. Finally, we show an improved estimation of annotators' behavior.INDEX TERMS Crowdsourcing, deep Gaussian processes, digital pathology, breast cancer. I. INTRODUCTIONMachine learning (ML) classification algorithms have achieved very promising results in the field of digital pathology [1], [2], [3], [4]. These methods extract knowledge from data that has been previously labeled by an expert pathologist. However, modern ML models require a large amount of The associate editor coordinating the review of this manuscript and approving it for publication was Ines Domingues .

IVNet: Transfer Learning Based Diagnosis of Breast Cancer Grading Using Histopathological Images of Infected Cells

“…We utilized a cutting-edge dataset JUMC Breast Cancer Grading, for building applied models. Our proposed method harnesses deep learning techniques to analyze histopathological images and identify affected cells with high-performance scores compared to state-of-the-art studies [18]. We employed transfer learning approaches, utilizing pre-trained models and neural network architectures.…”