This paper proposed a novel hearing loss detection method. Our method first used seven Hu moment invariants to extract features. Afterwards, we used support vector machine to act as the classifier. The 10x5-fold cross validation shows our method yielded an overall accuracy of 77.47± 1.17%. The sensitivities of healthy control, left-sided hearing loss, and right-sided hearing loss are 77.60± 5.72%, 77.60± 4.30%, and 77.20± 5.98%, respectively. In all, our method is effective in hearing loss identification.