Affective stimuli in our environment are important sources of information as they indicate reward or threat and thereby relate to approach and avoidance behavior. Previous findings have indicated that affective stimuli do not only influence behavioral responses but may also bias the perception of the stimuli (e.g., size, height, distance). Typically, such biases have been described in the visual domain, while it remains unclear whether similar effects can be observed for auditory stimuli. The present study asked whether the affective dimension of an auditory voice stimulus (i.e., angry vs neutral) would affect at which distance the stimulus source is perceived. Therefore, two Virtual Reality experiments were conducted in which participants listened to auditory stimuli played via loudspeakers while the position of the loudspeakers was unknown to the participants. In the first experiment (N = 44), participants had to actively place a visually presented virtual agent or virtual loudspeaker at the perceived sound source in an empty room. In the second experiment (N = 32), participants were placed in front of several virtual agents or virtual loudspeakers and had to indicate the sound source by looking at the person or loudspeaker who was thought to produce the sound. Results in both preregistered experiments consistently showed that participants estimated the location of angry voice stimuli at greater distances than the location of neutral voice stimuli. We discuss that neither emotional nor motivational biases may account for these results. Instead, distance estimates seem to rely on listeners' representations regarding the relationship between vocal affect and acoustic characteristic.