Trust levels of the popularity of deep learning models is enhanced throughXAI, which provides explanations and interpretations on the decisionsmade and also in making more interpretable decisions and explainableoutcomes. Recently, there has been a surge of interest in developingXAI models in medical fields such as oncology, ophthalmology pedi-atrics and orthopedics. In particular XAI is also advancing rapidly inpredicting psychological health conditions such as depression, stress, anxiety, ADHD, schizophrenia, neuropsychiatric problems and many others.The primary objective of this article is to review the recent findingsof the XAI models that are used for explanations for different diseaseswhich uses deep learning models with various forms of data. Finally,the focus is made on few issues and possibilities in medicine XAI.