The long-term impact of neurotological symptoms after a temporal bone fracture (TBF), including facial nerve palsy (FP), hearing loss, tinnitus, and dizziness on the quality of life of patients is often underevaluated. Thus, we retrospectively assessed 30 patients with TBF (26 men and 4 women) in our university tertiary referral center. They participated from injury onset to the final follow-up, over an 18-month period. Quality of life was estimated using validated questionnaires, such as the Facial Disability Index (FDI: physical and social), Hearing Handicap Inventory (HHI), Tinnitus Handicap Inventory (THI), and Dizziness Handicap Inventory (DHI). The FDI score was significantly worse in patients with severe initial (for physical FDI) and final facial palsy (for both physical and social FDI), mainly with immediate onset. The HHI score was statistically worse in patients with mixed hearing loss compared to those with conductive or sensorineural hearing loss and in those with profound hearing loss vs. normal hearing. The mixed TBF and the severity of hearing loss (especially profound hearing loss) were correlated with HHI, THI and DHI score values. In the long-term period after a TBF, moderate or severe facial palsy, mainly with immediate onset, may cause psychological distress, more easily resulting in social disability than functional impairment. Mixed TBF and mixed or profound hearing loss may also negatively influence quality of life.