Understanding the factors involved in the development of broadly neutralizing antibody (bNAb) responses in natural infection can guide vaccine design aimed at eliciting protective bNAb responses. Most of the studies to identify and study the development of bNAb responses have been performed in individuals who had become infected via homo- or heterosexual HIV-1 transmission; however, the prevalence and characteristics of bNAb responses in injecting drug users (IDUs) have been underrepresented. We retrospectively studied the prevalence of bNAb responses in HIV-1 infected individuals in the Amsterdam Cohort, including 50 male and 35 female participants who reported injecting drug use as the only risk factor. Our study revealed a significantly lower prevalence of bNAb responses in females compared to males. Gender, transmission route and CD4+ count at set point, but not viral load, were independently associated with the development of bNAb responses in IDUs. To further explore the influences of gender in the setting of IDU, we also looked into the Swiss 4.5k Screen. There we observed lower bNAb responses in female IDUs as well. These results reveal that the emergence of bNAbs may be dependent on multiple factors, including gender. Therefore, the effect of gender on the development of bNAb responses is a factor that should be taken into account when designing vaccine efficacy trials.