Dietary interventions have emerged as effective environmental inducers of brain plasticity. Among these dietary interventions, we here highlight the impact of caloric restriction (CR: a consistent reduction of total daily food intake), intermittent fasting (IF, every-other-day feeding), and diet supplementation with polyphenols and polyunsaturated fatty acids (PUFAs) on markers of brain plasticity in animal studies. Moreover, we also discuss epidemiological and intervention studies reporting the effects of CR, IF and dietary polyphenols and PUFAs on learning, memory, and mood. In particular, we evaluate the gap in mechanistic understanding between recent findings from animal studies and those human studies reporting that these dietary factors can benefit cognition, mood, and anxiety, aging, and Alzheimer's disease—with focus on the enhancement of structural and functional plasticity markers in the hippocampus, such as increased expression of neurotrophic factors, synaptic function and adult neurogenesis. Lastly, we discuss some of the obstacles to harnessing the promising effects of diet on brain plasticity in animal studies into effective recommendations and interventions to promote healthy brain function in humans. Together, these data reinforce the important translational concept that diet, a modifiable lifestyle factor, holds the ability to modulate brain health and function.