FairPrune: Achieving Fairness Through Pruning for Dermatological Disease Diagnosis

Abstract

Many works have shown that deep learning-based medical image classification models can exhibit bias toward certain demographic attributes like race, gender, and age. Existing bias mitigation methods primarily focus on learning debiased models, which may not necessarily guarantee all sensitive information can be removed and usually comes with considerable accuracy degradation on both privileged and unprivileged groups. To tackle this issue, we propose a method, FairPrune, that achieves fairness by pruning. Conventionally, pruning is used to reduce the model size for efficient inference. However, we show that pruning can also be a powerful tool to achieve fairness. Our observation is that during pruning, each parameter in the model has different importance for different groups' accuracy. By pruning the parameters based on this importance difference, we can reduce the accuracy difference between the privileged group and the unprivileged group to improve fairness without a large accuracy drop. To this end, we use the second derivative of the parameters of a pre-trained model to quantify the importance of each parameter with respect to the model accuracy for each group. Experiments on two skin lesion diagnosis datasets over multiple sensitive attributes demonstrate that our method can greatly improve fairness while keeping the average accuracy of both groups as high as possible.

FairAdaBN: Mitigating unfairness with adaptive batch normalization and its application to dermatological disease classification

“…Wu et. al [27] mitigate unfairness by pruning a pre-trained diagnosis model considering the difference of feature importance between subgroups. However, their method needs extra time except for training a precise classification model, while our FairAdaBN is a one-step method.…”

Distributed Contrastive Learning for Medical Image Segmentation

“…Deep learning (DL) provides state-of-the-art performance for medical applications such as image segmentation [1]- [4] and disease diagnosis [5], [6] by learning from largescale labeled datasets, without which the performance of DL will significantly degrade [7]. However, medical data exist in isolated medical centers and hospitals [8], and combining a large dataset consisting of very sensitive and private medical data in a single location is impractical and even illegal.…”