ObjectiveThere is a significant need in Pakistan to investigate the psychological effects of infertility on the mental health of infertile men. The current study examined how fear of intimacy affects neuropsychological impairment and evaluated its relationship to other variables including quality of life and mental toughness.MethodAn analytical cross-sectional study was carried out on infertile male patients in various healthcare settings in Punjab, Pakistan. The participants were recruited using a non-probability (purposive) sampling strategy. The sample size was 120 infertile. SPSS 26 was used to analyze the data.ResultsFear of intimacy was found significant impact on neuropsychological impairment (r = 0.40; ***p < 0.001), as well as fear of intimacy, significantly associated with emotional problems (r = 0.48; **p < 0.01), learning problems (r = 0.33; **p < 0.01), sensory and motor problem (r = 0.55; **p < 0.01), concentration problem (r = 0.21; **p < 0.01), mental & physical in coordination (r = 0.37; **p < 0.01) and depression (r = 0.22; **p < 0.01). Fear of intimacy has negative impact on QoL (r = −0.25; *p > 0.05). Similarly, neuropsychological impairment was found to be negatively associated with QoL (r = −0.52; **p > 0.01). The relationship between fear of intimacy and neuropsychological impairment was found to be significantly mediated by QoL. Furthermore, the findings revealed that mental toughness significantly moderated the relationship between fear of intimacy and neuropsychological impairment.ConclusionOverall, infertile men in Pakistan had relatively high levels of fear of intimacy, which largely caused neuropsychological impairment. This study can help neuropsychological researchers, mental health professionals, as well as policymakers in improving clinical mental health practices for infertile patients.