Background: Non-obstructive azoospermia (NOA) is a form of male infertility caused by disorders of the testicular parenchyma and impaired spermatogenesis. This study aimed to investigate the nature of Leydig cell changes in patients with NOA, especially whether their actual proliferation occurred. Methods: 48 testicular biopsies from infertile patients with NOA and 24 testicular biopsies originating from azoospermic patients suffering from obstructive azoospermia (OA) were included in the study. Leydig cells and their possible proliferative activity were analysed by immunohistochemistry and morphometry (stereology). Results: Unlike in the OA group, Leydig cells in NOA patients were sometimes organised into larger clusters and displayed an abundant cytoplasm/hypertrophy. Moreover, significant fibrosis of the interstitial compartment was demonstrated in some NOA samples, often accompanied by inflammatory cells. Stereological analysis showed no increase/proliferation of Leydig cells; on the contrary, these cells decreased in number in the NOA group. Conclusions: The decrease in the number of Leydig cells can be explained by previous inflammatory changes within the testicular interstitium and consequent interstitial fibrosis. The interstitial fibrosis might have a deteriorating effect on Leydig cells.