Background: Neuroimage literature of autism spectrum disorder (ASD) has a moderate-to-high risk of bias, partially because those combined with intellectual impairment (II) and/or minimally verbal (MV) status are generally ignored. We aimed to provide more comprehensive insights into white matter alterations of ASD, inclusive of individuals with II (ASD-II-Only) or MV expression (ASD-MV). Methods: Sixty-five participants with ASD (ASD-Whole; 16.6±5.9 years; comprising 34 intellectually able youth, ASD-IA, and 31 intellectually impaired youth, ASD-II, including 24 ASD-II-Only plus 7 ASD-MV) and 38 demographic-matched typically developing controls (TDC; 17.3±5.6 years) were scanned in accelerated diffusion-weighted MRI. Fixel-based analysis was undertaken to investigate the categorical differences in fiber density (FD), fiber cross-section (FC), and a combined index (FDC), and brain-symptom/cognition associations. Results: ASD-Whole had reduced FD in the anterior and posterior corpus callosum and left cerebellum Crus I, and smaller FDC in right cerebellum Crus II, compared to TDC. ASD-II, relative to TDC, showed almost identical alterations to those from ASD-Whole vs. TDC. ASD-II-Only had greater FD/FDC in the isthmus-splenium of callosum than ASD-MV. Autistic severity negatively correlated with FC in right Crus I. Non-verbal full-scale IQ positively correlated with FC/FDC in cerebellum VI. FD/FDC of the right dorsolateral prefrontal cortex showed a diagnosis-by-executive function interaction. Conclusions: ASD-associated white matter alterations appear driven by individuals combined with II and/or MV. Results suggest that changes in the corpus callosum and cerebellum are key for psychopathology and cognition associated with ASD. Our work highlights an essential to include understudied sub-populations on the spectrum in research.