Histopathology defines the gold standard in oncology. Automatic analysis of pathology images could thus have a significant impact on diagnoses, prognoses and treatment decisions for cancer patients. Recently, convolutional neural networks (CNNs) have shown strong performance in computational histopathology tasks. However, given it remains intractable to process pathology slides in their entirety, CNNs have traditionally performed inference on small individual patches extracted from the image. This often requires a significant amount of computation and can result in ignoring potentially relevant spatial and contextual information. Being able to process larger input patches and locating discriminatory regions more efficiently could help improve both computational and task specific performance. Inspired by the recent success of Deep Recurrent Attention Models (DRAMs) in image recognition tasks, we propose a novel attention-based architecture for classification in histopathology. Similar to CNNs, DRAMs have a degree of translation invariance built-in, but the amount of computation performed can be controlled independently from the input image size. The model is a deep recurrent neural network trained with reinforcement learning to attend to the most relevant areas of large input patches. We evaluate our model on histological and molecular subtype classification tasks for the glioma cohorts of The Cancer Genome Atlas (TCGA). Our results suggest that the DRAM has comparable performance to state-of-the-art CNNs despite only processing a select number of patches.
DNA methylation is an important epigenetic mechanism regulating gene expression and its role in carcinogenesis has been extensively studied. High-throughput DNA methylation assays have been used broadly in cancer research. Histopathology images are commonly obtained in cancer treatment, given that tissue sampling remains the clinical gold-standard for diagnosis. In this work, we investigate the interaction between cancer histopathology images and DNA methylation profiles to provide a better understanding of tumor pathobiology at the epigenetic level. We demonstrate that classical machine learning algorithms can associate the DNA methylation profiles of cancer samples with morphometric features extracted from whole slide images. Furthermore, grouping the genes into methylation clusters greatly improves the performance of the models. The well-predicted genes are enriched in key pathways in carcinogenesis including hypoxia in glioma and angiogenesis in renal cell carcinoma. Our results provide new insights into the link between histopathological and molecular data.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.