Permanent childhood hearing impairment (PCHI) represents the most frequent sensory pathology at birth. PCHI has a relevant psychological impact on the life of both the affected children and their families. Thus, the aim of this work is to explore the degree of parental distress felt by mothers of a deaf or hard-of-hearing child, to determine if this stress is associated with variables related to the children’s health (e.g., the severity of hearing loss, presence of other conditions, difficulty with treatment options, difficulty with rehabilitation) or family characteristics such as socio-economic and educational status. The study used the Parenting Stress Index–Short Form (PSI-SF) questionnaire administered to mothers. The results were analyzed in relation to variables such as parents’ education level, number of children, severity of hearing loss, presence of other chronic conditions, presence of cognitive delay, familiarity with hearing loss, time of diagnosis, use of prosthetics, and start in a rehabilitation program. The data indicate a correlation between maternal stress levels and low-educational levels, as well as the presence of congenital infections and cognitive delay. These results highlight the need for a comprehensive physical and psychological approach for hearing-impaired children, as stress factors can affect the adherence to effective rehabilitation.