Intellectual disability (ID) and autism spectrum disorder (ASD) are the most common neurodevelopmental disorders and are characterized by substantial impairment in intellectual and adaptive functioning, with their genetic and molecular basis remaining largely unknown. Here, we identify biallelic variants in the gene encoding one of the Elongator complex subunits, ELP2, in patients with ID and ASD. Modelling the variants in mice recapitulates the patient features, with brain imaging and tractography analysis revealing microcephaly, loss of white matter tract integrity and an aberrant functional connectome. We show that the Elp2 mutations negatively impact the activity of the complex and its function in translation via tRNA modification. Further, we elucidate that the mutations perturb protein homeostasis leading to impaired neurogenesis, myelin loss and neurodegeneration. Collectively, our data demonstrate an unexpected role for tRNA modification in the pathogenesis of monogenic ID and ASD and define Elp2 as a key regulator of brain development.