Poor binaural hearing in children was hypothesized to contribute to related cognitive and academic deficits. Children with unilateral hearing have normal hearing in one ear but no access to binaural cues. Their cognitive and academic deficits could be unique from children receiving bilateral cochlear implants (CIs) at young ages who have poor access to spectral cues and impaired binaural sensitivity. Both groups are at risk for vestibular/balance deficits which could further contribute to memory and learning challenges. Eighty-eight children (43 male:45 female, aged 9.89  ±  3.40 years), grouped by unilateral hearing loss ( n = 20), bilateral CI ( n = 32), and typically developing ( n = 36), completed a battery of sensory, cognitive, and academic tests. Analyses revealed that children in both hearing loss groups had significantly poorer skills (accounting for age) on most tests than their normal hearing peers. Children with unilateral hearing loss had more asymmetric speech perception than children with bilateral CIs ( p < .0001) but balance and language deficits ( p = .0004, p < .0001, respectively) were similar in the two hearing loss groups ( p > .05). Visuospatial memory deficits occurred in both hearing loss groups ( p = .02) but more consistently across tests in children with unilateral hearing loss. Verbal memory was not significantly different than normal ( p > .05). Principal component analyses revealed deficits in a main cluster of visuospatial memory, oral language, mathematics, and reading measures (explaining 46.8% data variability). The remaining components revealed clusters of self-reported hearing, balance and vestibular function, and speech perception deficits. The findings indicate significant developmental impacts of poor binaural hearing in children.