AutoIHC‐Analyzer: computer‐assisted microscopy for automated membrane extraction/scoring in HER2 molecular markers

Abstract

Summary Human epidermal growth factor receptor 2 (HER2) is one of the widely used Immunohistochemical (IHC) markers for prognostic evaluation amongst the patient of breast cancer. Accurate quantification of cell membrane is essential for HER2 scoring in therapeutic decision making. In modern laboratory practice, expert pathologist visually assesses the HER2‐stained tissue sample under the bright field microscope for cell membrane assessment. This manual assessment is time consuming, tedious and quite often results in interobserver variability. Further, the burden of increasing number of patients is a challenge for the pathologists. To address these challenges, there is an urgent need with a rapid HER2 cell membrane extraction method. The proposed study aims at developing an automated IHC scoring system, termed as AutoIHC‐Analyzer, for automated cell membrane extraction followed by HER2 molecular expression assessment from stained tissue images. A series of image processing approaches have been used to automatically extract the stained cells and membrane region, followed by automatic assessment of complete and broken membrane. Finally, a set of features are used to automatically classify the tissue under observation for the quantitative scoring as 0/1+, 2+ and 3+. In a set of surgically extracted cases of HER2‐stained tissues, obtained from collaborative hospital for the testing and validation of the proposed approach AutoIHC‐Analyzer and publicly available open source ImmunoMembrane software are compared for 90 set of randomly acquired images with the scores by expert pathologist where significant correlation is observed [(r = 0.9448; p < 0.001) and (r = 0.8521; p < 0.001)] respectively. The output shows promising quantification in automated scoring. Lay description In cancer prognosis amongst the patient of breast cancer, human epidermal growth factor receptor 2 (HER2) is used as Immunohistochemical (IHC) biomarker. The correct assessment of HER2 leads to the therapeutic decision making. In regular practice, the stained tissue sample is observed under a bright microscope and the expert pathologists score the sample as negative (0/1+), equivocal (2+) and positive (3+) case. The scoring is based on the standard guidelines relating the complete and broken cell membrane as well as intensity of staining in the membrane boundary. Such evaluation is time consuming, tedious and quite often results in interobserver variability. To assist in rapid HER2 cell membrane assessment, the proposed study aims at developing an automated IHC scoring system, termed as AutoIHC‐Analyzer, for automated cell membrane extraction followed by HER2 molecular expression assessment from stained tissue images. The input image is preprocessed using modified white patch and CMYK and RGB colour space were used in extracting the haematoxylin (negatively stained cells) and diaminobenzidine (DAB) stain observed in the tumour cell membrane. Segmentation and postprocessing are applied to create the masks for each of the stain channels. The membrane ma...

The role of artificial intelligence in accurate interpretation of HER2 IHC 0 and 1+ in breast cancers

“…AI has great advantages in the interpretation of IHC results and can be one of possible solutions to increase the accuracy and consistency in HER2 interpretation in the HER2 low-expressing tumors. Although several AI models have been proposed [22][23][24] , the AI algorithm which we proposed in this study was the rst one to focus on the accurate interpretation of HER2 0 and HER2 1+. In the RS1 of this study, there were no signi cant differences among pathologists, and the accuracy in distinguishing HER2 0 from HER2 1 + tumors was poor, regardless of their levels of experience.…”

Deep Transfer Learning-Based Approach for Glucose Transporter-1 (GLUT1) Expression Assessment

“…Mukundan [ 19 ] has employed uniform local binary pattern (ULBP), characteristic curves, entropy and energy features with logistic regression and SVM classifier to score HER2-stained tissue samples. Tewary et al [ 20 ] have utilised colour space-based membrane extraction followed by an SVM classifier for HER2 scoring. Chang et al [ 21 ] have employed the colour channel to extract the morphology, texture and intensity features, and then they were utilised for training the SVM classifier.…”

Immunohistochemistry as a detection tool for ion channels involved in dental pain signaling

“…This method, also known as computer-assisted imaging (CAI), uses algorithms to identify a labeled structure, usually by physical differences, such as color, to produce the required measurement outcomes—volume, surface area, length, and staining intensity of the labeled structures. Today, different CAI algorithms are available to analyze images from different tissues and IHC staining techniques for both biomedical research and diagnostic laboratories ( Dixon et al, 2015 , Fassler et al, 2020 , Guirado et al, 2018 , Jawad and Abdullah, 2017 , Lee et al, 2019 , Tewary et al, 2021 ).…”