It is typically recommended that panelists should refrain from wearing personal fragrances, such as perfume or cologne, prior to sensory evaluation. Interestingly, no study has been reported as to whether panelists’ perceptions of test samples could be affected by personal fragrances worn by themselves. The objective of this study was, therefore, to determine the effect of such a personal fragrance on olfactory performance. Nineteen untrained participants were screened, recruited for, and underwent the Sniffin’ Sticks test designed for measuring olfactory performances that included the odor threshold, discrimination, and identification (TDI). The olfactory performance tasks were conducted under three fragrance level conditions: (1) control (no fragrance), (2) just-about-right (JAR), and (3) excessive, with a preliminary study used to identify both the JAR and excessive fragrance levels. The results showed that the odor discrimination, odor threshold, and combined TDI performances were significantly lowered in the two conditions with the perfume fragrance, while the odor identification performance exhibited no significant differences across all three conditions. These findings provide empirical evidence that even low to moderate levels of personal fragrance can significantly reduce individuals’ olfactory capabilities, possibly subsequently altering the perception of test samples during sensory evaluation.