Patients with autism spectrum disorder (ASD) often show pervasive and complex language impairments that are closely associated with aberrant structural connectivity of language networks. However, the characteristics of white matter connectivity in ASD have remained inconclusive in previous diffusion tensor imaging (DTI) studies. The current meta‐analysis aimed to comprehensively elucidate the abnormality in language‐related white matter connectivity in individuals with ASD. We searched PubMed, Web of Science, Scopus, and Medline databases to identify relevant studies. The standardized mean difference was calculated to measure the pooled difference in DTI metrics in each tract between the ASD and typically developing (TD) groups. The moderating effects of age, sex, language ability, and symptom severity were investigated using subgroup and meta‐regression analysis. Thirty‐three DTI studies involving 831 individuals with ASD and 836 TD controls were included in the meta‐analysis. ASD subjects showed significantly lower fractional anisotropy or higher mean diffusivity across language‐associated tracts than TD controls. These abnormalities tended to be more prominent in the left language networks than in the right. In addition, children with ASD exhibit more pronounced and pervasive disturbances in white matter connectivity than adults. These results support the under‐connectivity hypothesis and demonstrate the widespread abnormal microstructure of language‐related tracts in patients with ASD. Otherwise, white matter abnormalities in the autistic brain could vary depending on the developmental stage and hemisphere. Lay Summary This meta‐analysis explored abnormalities in white matter connectivity in language networks of individuals with ASD. Significantly reduced white matter integrity was found in all language‐associated tracts in subjects with ASD compared with TD controls. In addition, structural disturbances of language networks in the autistic brain exhibit a leftward tendency, and more prominent abnormalities are observed in younger people with ASD than in adults.