Understanding the genetics of neuropsychiatric disorders requires an understanding of the genetics of brain structure and function. The Vietnam Era Twin Study of Aging (VETSA) is a longitudinal behavioral genetic study focused on cognitive and brain aging. Here, we describe basic science work carried out within the VETSA MRI study that provides meaningful contributions toward the study of neuropsychiatric disorders. VETSA produced the first comprehensive assessment of the heritability of cortical and subcortical brain structure sizes, all within the same individuals. We showed that neocortical thickness and surface area are largely genetically distinct. With continuous neocortical thickness maps, we demonstrated regional specificity of genetic influences, and that genetic factors did not conform to traditional regions of interest (ROIs). However, there was some evidence for different genetic factors accounting for different types of cortex, and for genetic relationships across cortical regions corresponding to anatomical and functional connectivity and brain maturation patterns. With continuous neocortical surface area maps, we confirmed the anterior–posterior gradient of genetic influences on cortical area patterning demonstrated in animal models. Finally, we used twin methods to create the first map of cortical ROIs based entirely on genetically informative data. We conclude that these genetically based cortical phenotypes may be more appropriate for genetic studies than traditional ROIs based on structure or function. Our results also suggest that cortical volume—the product of thickness and surface area is a problematic phenotype for genetic studies because two independent sets of genes may be obscured. Examples supporting the validity of these conclusions are provided.