Human cortex is patterned by a complex and interdigitated web of large-scale functional networks. Recent methodological breakthroughs reveal variation in the size, shape, and spatial topography of cortical networks across individuals. While spatial network organization emerges across development, is stable over time, and predictive of behavior, it is not yet clear to what extent genetic factors underlie inter-individual differences in network topography. Here, leveraging a novel non-linear multi-dimensional estimation of heritability, we provide evidence that individual variability in the size and topographic organization of cortical networks are under genetic control. Using twin and family data from the Human Connectome Project (n=1,023), we find increased variability and reduced heritability in the size of heteromodal association networks (h2: M=0.33, SD=0.071), relative to unimodal sensory/motor cortex (h2: M=0.44, SD=0.051). We then demonstrate that the spatial layout of cortical networks is influenced by genetics, using our multi-dimensional estimation of heritability (h2-multi; M=0.14, SD=0.015). However, topographic heritability did not differ between heteromodal and unimodal networks. Genetic factors had a regionally variable influence on brain organization, such that the heritability of network topography was greatest in prefrontal, precuneus, and posterior parietal cortex. Taken together, these data are consistent with relaxed genetic control of association cortices relative to primary sensory/motor regions, and have implications for understanding population-level variability in brain functioning, guiding both individualized prediction and the interpretation of analyses that integrate genetics and neuroimaging.