The cerebellum is a large hindbrain structure that is increasingly recognized for its contribution to diverse domains of cognitive and affective processing in human health and disease. Although several of these domains are sex biased, our fundamental understanding of cerebellar sex differences-including their spatial distribution, potential biological determinants, and independence from brain volume variation-lags far behind that for the cerebrum. Here, we harness automated neuroimaging methods for cerebellar morphometrics in 417 individuals to (1) localize normative male-female differences in raw cerebellar volume, (2) compare these to sex chromosome effects estimated across five rare sex (X/Y) chromosome aneuploidy (SCA) syndromes, and (3) clarify brain size-independent effects of sex and SCA on cerebellar anatomy using a generalizable allometric approach that considers scaling relationships between regional cerebellar volume and brain volume in health. The integration of these approaches shows that (1) sex and SCA effects on raw cerebellar volume are large and distributed, but regionally heterogeneous, (2) human cerebellar volume scales with brain volume in a highly nonlinear and regionally heterogeneous fashion that departs from documented patterns of cerebellar scaling in phylogeny, and (3) cerebellar organization is modified in a brain size-independent manner by sex (relative expansion of total cerebellum, flocculus, and Crus II-lobule VIIIB volumes in males) and SCA (contraction of total cerebellar, lobule IV, and Crus I volumes with additional X-or Y-chromosomes; X-specific contraction of Crus II-lobule VIIIB). Our methods and results clarify the shifts in human cerebellar organization that accompany interwoven variations in sex, sex chromosome complement, and brain size.