In this work, we investigated the relationship between structural connectivity and the dynamics of functional connectivity and how this relationship changes with age to benefit cognitive functions. Visual working memory (VWM) is an important brain function that allows us to maintain a mental representation of the world around us, but its capacity and precision peaks by around 20 years old and decreases steadily throughout the rest of our lives. This research examined the functional brain network dynamics associated with VWM throughout the lifespan and found that Default Mode Network and Fronto-Parietal Network states were more well represented in individuals with better VWM. Furthermore, transitions between the Visual/Somatomotor Network state and the Attention Network state were more well-represented in older adults, and a network control theory simulation demonstrated that structural connectivity differences supporting this transition were associated with better VWM, especially in middle-aged individuals. The structural connectivity of regions from all states was important for supporting this transition in younger adults, while regions within the Visual/Somatomotor and Attention Network states were more important in older adults. These findings demonstrate that structural connectivity supports flexible, functional dynamics that allow for better VWM with age and may lead to important interventions to uphold healthy VWM throughout the lifespan.