The brain’s serotonergic system plays a crucial role in the processing of emotional stimuli, and several studies have shown that a reduced serotonergic neurotransmission is associated with an increase in amygdala activity during emotional face processing. Prolonged recreational use of ecstasy (3,4-methylene-dioxymethamphetamine [MDMA]) induces alterations in serotonergic neurotransmission that are comparable to those observed in a depleted state. In this functional magnetic resonance imaging (fMRI) study, we investigated the responsiveness of the amygdala to emotional face stimuli in recreational ecstasy users as a model of long-term serotonin depletion. Fourteen ecstasy users and 12 non-using controls underwent fMRI to measure the regional neural activity elicited in the amygdala by male or female faces expressing anger, disgust, fear, sadness, or no emotion. During fMRI, participants made a sex judgement on each face stimulus. Positron emission tomography with 11C-DASB was additionally performed to assess serotonin transporter (SERT) binding in the brain. In the ecstasy users, SERT binding correlated negatively with amygdala activity, and accumulated lifetime intake of ecstasy tablets was associated with an increase in amygdala activity during angry face processing. Conversely, time since the last ecstasy intake was associated with a trend toward a decrease in amygdala activity during angry and sad face processing. These results indicate that the effects of long-term serotonin depletion resulting from ecstasy use are dose-dependent, affecting the functional neural basis of emotional face processing.