Most prior research has focused on characterizing averages in cognition, brain characteristics, or behavior, and attempting to predict differences in these averages among individuals. However, this overwhelming focus on mean levels may leave us with an incomplete picture of what drives individual differences in behavioral phenotypes by ignoring the variability of behavior around an individual’s mean. In particular, enhanced white matter (WM) structural microstructure has been hypothesized to supportconsistentbehavioral performance by decreasing gaussian noise in signal transfer. Conversely, lower indices of white matter microstructure are associated with greater within-subject variance in the ability to deploy performance-related resources, especially in clinical populations. We tested a mechanistic account of the ‘neural noise’ hypothesis in a large adult lifespan cohort (Cam-CAN) with over 2500 adults (ages 18–102; 1508 female; 1173 male; 2681 behavioral sessions; 708 MRI scans) using WM fractional anisotropy (FA) to predict mean levels and variability in reaction time performance on a simple behavioral task using a dynamic structural equation model (DSEM). By modeling robust and reliable individual differences in within-person variability, we found support for a neural noise hypothesis (Kail, 1997), with lower FA predicted individual differences in separable components of behavioral performance estimated using DSEM, including slower mean responses and increased variability. These effects remained when including age, suggesting consistent effects of WM microstructure across the adult lifespan unique from concurrent effects of ageing. Crucially, we show that variability can be reliably separated from mean performance using advanced modeling tools, enabling tests of distinct hypotheses for each component of performance.Significance Statement:Human cognitive performance is defined not just by the long-run average, but trial-to-trial variability around that average. However, investigations of cognitive abilities and changes during aging have largely ignored this variability component of behavior. We provide evidence that white matter microstructure predicts individual differences in mean performanceandvariability in a sample spanning the adult lifespan (18-102). Unlike prior studies of cognitive performance and variability, we modeled variability directly and distinct from mean performance using a dynamic structural equation model, which allows us to de-couple variability from mean performance and other complex features of performance (e.g., autoregression). The effects of WM were robust above the effect of age, highlighting the role of WM in promoting fast andconsistentperformance.