Background: The frequently cited Early Overgrowth Hypothesis of autism spectrum disorder (ASD) postulates that there is overgrowth of the brain in the first 2 years of life, which is followed by a period of arrested growth leading to normalized brain volume in late childhood and beyond. While there is consistent evidence for early brain overgrowth, there is mixed evidence for normalization of brain volume by middle childhood. The outcome of this debate is important to understanding the etiology and neurodevelopmental trajectories of ASD. Methods: Brain volume was examined in two very large single-site samples of children, adolescents, and adults. The primary sample comprised 456 6-25-year-olds (ASD n = 240, typically developing controls (TDC) n = 216), including a large number of females (n = 102) and spanning a wide IQ range (47-158). The replication sample included 175 males. High-resolution T1-weighted anatomical MRI images were examined for group differences in total brain, cerebellar, ventricular, gray, and white matter volumes. Results: The ASD group had significantly larger total brain, cerebellar, gray matter, white matter, and lateral ventricular volumes in both samples, indicating that brain volume remains enlarged through young adulthood, rather than normalizing. There were no significant age or sex interactions with diagnosis in these measures. However, a significant diagnosis-by-IQ interaction was detected in the larger sample, such that increased brain volume was related to higher IQ in the TDCs, but not in the ASD group. Regions-of-significance analysis indicated that total brain volume was larger in ASD than TDC for individuals with IQ less than 115, providing a potential explanation for prior inconsistent brain size results. No relationships were found between brain volume and measures of autism symptom severity within the ASD group. Limitations: Our cross-sectional sample may not reflect individual changes over time in brain volume and cannot quantify potential changes in volume prior to age 6.