Investigating and Assessing the Dermoepidermal Junction with Multiphoton Microscopy and Deep Learning

Abstract

Histopathological image analysis performed by a trained expert is currently regarded as the goldstandard in the case of many pathologies, including cancers. However, such approaches are laborious, time consuming and contain a risk for bias or human error. There is thus a clear need for faster, less intrusive and more accurate diagnostic solutions, requiring also minimal human intervention. Multiphoton Microscopy (MPM) can alleviate some of the drawbacks specific to traditional histopathology by exploiting various endogenous optical signals to provide virtual biopsies that reflect the architecture and composition of tissues, both in-vivo or ex-vivo. Here we show that MPM imaging of the dermoepidermal junction (DEJ) in unstained tissues provides useful cues for a histopathologist to identify the onset of non-melanoma skin cancers. Furthermore, we show that MPM images collected on the DEJ, besides being easy to interpret by a trained specialist, can be automatically classified into healthy and dysplastic classes with high precision using a Deep Learning method and existing pre-trained Convolutional Neural Networks. Our results suggest that Deep Learning enhanced MPM for in-vivo skin cancer screening could facilitate timely diagnosis and intervention, enabling thus more optimal therapeutic approaches.3

Multiphoton microscopy of the dermoepidermal junction and automated identification of dysplastic tissues with deep learning

“…4 we present a set of MPM images (overlaid TPEF and SHG signals) of the DEJ, collected on normal and dysplastic unstained epithelial tissues (transversal sections, see Section 2.3), accompanied by BM images collected on the corresponding regions of the pair H&E stained tissues. A version of the MPM images without annotation masks is available in [51].…”

“…5, containing relevant borders of such tumors, are in accordance with this previous study, the DEJ no longer being visible. A version of these images without annotation masks is available in [51]. These images contain nonetheless features that allow a histopathologist to assess the tissue state, and tumor invasion patterns.…”