Hair removal in dermoscopy images using variational autoencoders

Abstract

Background: In recent years, melanoma is rising at a faster rate compared to other cancers. Although it is the most serious type of skin cancer, the diagnosis at early stages makes it curable. Dermoscopy is a reliable medical technique used to detect melanoma by using a dermoscope to examine the skin. In the last few decades, digital imaging devices have made great progress which allowed capturing and storing high-quality images from these examinations. The stored images are now being standardized and used for the automatic detection of melanoma. However, when the hair covers the skin, this makes the task challenging. Therefore, it is important to eliminate the hair to get accurate results. Methods:In this paper, we propose a simple yet efficient method for hair removal using a variational autoencoder without the need for paired samples. The encoder takes as input a dermoscopy image and builds a latent distribution that ignores hair as it is considered noise, while the decoder reconstructs a hair-free image. Both encoder and decoder use a decent convolutional neural networks architecture that provides high performance. The construction of our model comprises two stages of training. In the first stage, the model has trained on hair-occluded images to output hair-free images, and in the second stage, it is optimized using hair-free images to preserve the image textures. Although the variational autoencoder produces hair-free images, it does not maintain the quality of the generated images. Thus, we explored the use of three-loss functions including the structural similarity index (SSIM), L1-norm, and L2-norm to improve the visual quality of the generated images. Results:The evaluation of the hair-free reconstructed images is carried out using tdistributed stochastic neighbor embedding (SNE) feature mapping by visualizing the distribution of the real hair-free images and the synthesized hair-free images. The conducted experiments on the publicly available dataset HAM10000 show that our method is very efficient.

Enhancing assisted diagnostic accuracy in scalp psoriasis: A Multi‐Network Fusion Object Detection Framework for dermoscopic pattern diagnosis

“…Many scholars have reduced the effect of hair on recognition by eliminating hair in the study of skin disease recognition, Dalal et al. investigated an encoder‐decoder architecture based on a variational AE model to deal with hair in melanoma and obtained better results 17 . However, in our study, the number of hairs is large and partially obscures the scalp lesion area, and using CLAHE to enhance the feature contrast between the hairs and the scalp lesion area can effectively minimize the effect of hairs in the lesion area recognition task.…”

Ensemble feature selection and tabular data augmentation with generative adversarial networks to enhance cutaneous melanoma identification and interpretability

“…These artifacts not only hamper lesion segmentation and diagnosis but also hinder feature extraction. Among these artifacts, hair has a significant impact because its presence leads to occlusion of the texture, color, and boundary of the skin lesion [38]. To address this, a preprocessing stage was conducted, including image resizing, hair removal, and lesion segmentation.…”

EVAE-Net: An Ensemble Variational Autoencoder Deep Learning Network for COVID-19 Classification Based on Chest X-ray Images

“…In recent years, autoencoders (AEs) and variational autoencoders (VAEs) have been exploited for different medical tasks [ 68 , 69 , 70 , 71 , 72 , 73 , 74 ]. Given input data, AEs and VAEs transform the input from a high dimension to a low dimension known as a latent vector.…”