Purpose: to present a methodological approach for interpreting perceptual judgments of vocal quality by a group of evaluators who used the script Vocal Profile Analysis Scheme. Methods: cross-sectional study based on 90 speech samples from 25 female teachers with voice disorders and/or laryngeal changes. Prior to the perceptual judgment, we performed three perceptual tasks to select samples which were then presented to five evaluators using the Experiment script MFC 3.2 (software PRAAT). Next, we applied a sequence of tests based on successive approaches to inter-and intra-evaluator behavior. Data were treated by statistical analysis (Cochran and Selenor tests).Results: with respect to the analysis of the evaluators' performance, it was possible to define those that presented the best results, in terms of reliability and proximity of analyses, compared to the most experienced evaluator, excluding one. The results of the cluster analysis also allowed designing a voice quality profile of the group of speakers studied. Conclusions: the proposal of a methodological approach allowed defining evaluators whose judgments were based on phonetic knowledge, and drawing a vocal quality profile of the group of samples analyzed.