People evaluated their own voices as sounding more attractive than others rated their voices (i.e., self-enhancement effect from the perspective of the rater, termed "SE_rater"), and people also rated their own voices as more attractive than the voices of others (i.e., self-enhancement effect from the perspective of the voice, termed "SE_voice"). The aim of the present study is to explore whether the gender context (i.e., same-sex and opposite-sex rating context) could influence the SE effect of voice attractiveness evaluation. Male and female participants were asked to rate the attractiveness of their own voices and other participants' voices, either in a same-sex session or an opposite-sex session. The results demonstrated both the SE_rater and SE_voice effect in the same-sex and oppositesex contexts, for both male and female. More importantly, we found that the SE_rater for the male voices was significantly greater than that for the female voices in the same-sex context whereas no such difference was found in the opposite-sex context. In addition, the SE_voice effect in men was larger in the same-sex context than that in the oppositesex context whereas the SE_voice in women was smaller in the same-sex context than that in the opposite-sex context. These findings indicated that the self-enhancement effect of vocal attractiveness was modulated by the gender context.