Although attention and early associative learning in preverbal children is predominantly driven by rapid eye-movements in response to moving visual stimuli and sounds/words (e.g., associating the word “bottle” with the object), the literature examining the role of visual attention and memory in ongoing vocabulary development across childhood is limited. Thus, this systematic review and meta-analysis examined the association between visual memory and vocabulary development, including moderators such as age and task selection, in neurotypical children aged 2-to-12 years, from the brain-based perspective of cognitive neuroscience. Visual memory tasks were classified according to the visual characteristics of the stimuli and the neural networks known to preferentially process such information, including consideration of the distinction between the ventral visual stream (processing more static visuo-perceptual details, such as form or colour) and the more dynamic dorsal visual stream (processing spatial temporal action-driven information). Final classifications included spatio-temporal span tasks, visuo-perceptual or spatial concurrent array tasks, and executive judgment tasks. Visuo-perceptual concurrent array tasks, reliant on ventral stream processing, were moderately associated with vocabulary, while tasks measuring spatio-temporal spans, associated with dorsal stream processing, and executive judgment tasks (central executive), showed only weak correlations with vocabulary. These findings have important implications for health professionals and researchers interested in language, as they advocate for the development of more targeted language learning interventions that include specific and relevant aspects of visual processing and memory, such as ventral stream visuo-perceptual details (i.e., shape or colour).