Listeners are highly familiar with different kinds of musical styles and voices of different colors and expressions. Research so far has focused on vocal features associated with emotion expression by speaking voices, typically using acoustical measures. Little research has been done on voice judgments, including aesthetic judgments, liked or disliked voices, and emotions evoked by voices. It is striking that hardly any study has included the participants’ perception of vocal features. A reason might lie in the lack of a tool that can be used by non-expert listeners to describe vocal expression – a necessity if a comparison is to be made between perception and judgment. With a combined methods approach, three studies aimed at evaluating a tool for the description of voices for non-experts. Developed from interviews (N = 20), a group study (N = 48), and a German (N = 216) and an English online survey (N = 50), a set of nine items was created for the evaluation of singing voices in popular music styles. The final tool ‘EVEx9’ produces vocal profiles that can discriminate between different popular music voices comprising items from different categories of vocal expression, which are sound qualities, pitch changes, mode of phonation (song or speech), articulation, and overall expression. The tool was evaluated with voice experts (with a background in singing and speaking) and non-experts alike, as well as in a German and an English version. The short tool can be used in future research whenever non-expert evaluation of singing voices is needed.