Background: Accurate data on the prevalence of hearing impairment and severity across age and gender are paramount to formulate hearing health policies. Here, we sought to analyze audiometric data from a large group of age-diverse people in Japan, which has not been previously described in detail. Methods: We analyzed retrospective hearing threshold data of 23,860 participants (10–99 years; left-right hearing threshold difference <15 dB; air-bone gap ≤10 dB) at 500, 1000, 2000, and 4000 Hz, and then classified them for hearing impairment severity according to the WHO Classification. Findings: There was a significant gender difference in median hearing thresholds, starting in 20-year-olds up to early 80-year-olds. Twenty-five percent of men in their late 50s had some level of HI, ~50% in their late 60s, and ~75% in their late 70s. For women, 25% had some level of HI in their early 60s, ~50% in their early 70s, and ~75% in their late 70s. For participants in their early 80s, 50% of either gender had moderate or more severe HI. Interpretation: Our results, derived from a large number of participants, provide basic information about the prevalence of hearing loss by age decade. Since people can expect to live longer than those in previous generations, our detailed data can inform national social systems responsible for hearing screening in making decisions about hearing-aid qualification, which may reduce barriers to older people’s independence, productivity, and quality of life.