Maximal longevity of endotherms has long been considered to increase with decreasing specific metabolic rate, and thus with increasing body mass. Using a dataset of over 700 species, here I show that maximal longevity, age at sexual maturity, and postmaturity longevity across bird and mammalian species instead correlate primarily, and universally, with the number of cortical brain neurons. Correlations with metabolic rate and body mass are entirely explained by clade‐specific relationships between these variables and numbers of cortical neurons across species. Importantly, humans reach sexual maturity and subsequently live just as long as expected for their number of cortical neurons, which eliminates the basis for earlier theories of protracted childhood and prolonged post‐menopause longevity as derived human characteristics. Longevity might increase together with numbers of cortical neurons through their impact on three main factors: delay of sexual maturity, which postpones the onset of aging; lengthening of the period of viable physiological integration and adaptation, which increases postmaturity longevity; and improved cognitive capabilities that benefit survival of the self and of longer‐lived progeny, and are conducive to prolonged learning and cultural transmission through increased generational overlap. Importantly, the findings indicate that theories of aging and neurodegenerative diseases should take absolute time lived besides relative “age” into consideration.