The aim of the study was to identify nutrients that have the ability to impact brain functioning and, as a consequence, influence episodic memory. In particular, we examined recollection, the ability to recall details of previous experiences, which is the episodic memory process most affected as age advances. A sample of 1,550 healthy participants between 21 and 80 years old participated in the study. Nutritional intake was examined through a food frequency questionnaire and software developed to determine the daily consumption of 64 nutrients based on food intake during the last year. Recollection was measured through a computerized source memory paradigm. First, we identified which nutrients influence recollection across the entire adult life span. Then, moderator analyses were conducted by dividing the sample into young (21–40 years old), middle-aged (41–60 years old) and older (61–80 years old) adults to establish in which life stage nutrients influence episodic memory. Across the adult life span, recollection accuracy was shown to benefit from the intake of sodium, heme, vitamin E, niacin, vitamin B6, cholesterol, alcohol, fat, protein, and palmitic, stearic, palmitoleic, oleic, gadoleic, alpha-linoleic and linoleic acid. The effects of energy, maltose, lactose, calcium and several saturated fatty acids on recollection were modulated by age; in older adults, the consumption of these nutrients negatively influenced episodic memory performance, and in middle-aged adults, only lactose had negative effects. Several brain mechanisms that support episodic memory were influenced by specific nutrients, demonstrating the ability of food to enhance or deteriorate episodic memory.