The central nervous system (CNS) is the cellular substrate for the integration of complex, dynamic, constant, and simultaneous interactions among endogenous and exogenous stimuli across the entire human lifespan. Numerous studies on aging-related brain diseases show that some genes identified as risk factors for some of the most common neurodegenerative diseases - such as the allele 4 of APOE gene (APOE4) for Alzheimer’s disease (AD) - have a much earlier neuro-anatomical and neuro-physiological impact. The impact of APOE polymorphism appears in fact to start as early as youth and early-adult life. Intriguingly, though, those same genes associated with aging-related brain diseases seem to influence different aspects of the brain functioning much earlier actually, that is, even from the neonatal periods and earlier. The APOE4, an allele classically associated with later-life neurodegenerative disorders as AD, seems in fact to exert a series of very early effects on phenomena of neuroplasticity and synaptogenesis that begin from the earliest periods of life such as the fetal ones.We reviewed some of the findings supporting the hypothesis that APOE polymorphism is an early modifier of various neurobiological aspects across the entire human lifespan - from the in-utero to the centenarian life - during both normal and pathological conditions of the brain.