Chocolate, which is produced from cocoa, exerts antioxidant and anti-inflammatory effects that ameliorate neurodegenerative diseases. We hypothesized that chocolate consumption would protect against hearing loss and tinnitus. We evaluated the hearing and tinnitus data, as well as the chocolate consumption, of middle-aged participants (40–64 years of age) of the 2012–2013 Korean National Health and Nutrition Examination Survey. All of the subjects underwent a medical interview, physical examination, audiological evaluation, tinnitus questionnaire, and nutrition examination. A total of 3575 subjects 40–64 years of age were enrolled. The rate of any hearing loss (unilateral or bilateral) in the subjects who consumed chocolate (26.78% (338/1262)) was significantly lower than that in those who did not (35.97% (832/2313)) (p < 0.001). Chocolate consumption was independently associated with low odds of any hearing loss (adjusted odds ratio = 0.83, 95% confidence interval = 0.70 to 0.98, p = 0.03). Moreover, the severity of hearing loss was inversely correlated with the frequency of chocolate consumption. In contrast to chocolate, there was no association between hearing loss and the consumption of sweet products without cocoa. Chocolate consumption was also not associated with tinnitus or tinnitus-related annoyance. Our results suggest that a chocolate-based diet may protect middle-aged people from hearing loss.