Population aging has become a serious social problem. Accordingly, many researches are focusing on changes in brains of the elderly. In this study, we used multiple parameters to analyze age-related changes in white matter fibers. A sample cohort of 58 individuals was divided into young and middle-age groups and tract-based spatial statistics (TBSS) were used to analyze the differences in fractional anisotropy (FA), mean diffusion (MD), axial diffusion (AD), and radial diffusion (RD) between the two groups. Deterministic fiber tracking was used to investigate the correlation between fiber number and fiber length with age. The TBSS analysis revealed significant differences in FA, MD, AD, and RD in multiple white matter fibers between the two groups. In the middle-age group FA and AD were lower than in young people, whereas the MD and RD values were higher. Deterministic fiber tracking showed that the fiber length of some fibers correlated positively with age. These fibers were observed in the splenium of corpus callosum (SCC), the posterior limb of internal capsule (PLIC), the right posterior corona radiata (PCR_R), the anterior corona radiata (ACR), the left posterior thalamic radiation (include optic radiation; PTR_L), and the left superior longitudinal fasciculus (SLF_L), among others. The results showed that the SCC, PLIC, PCR_R, ACR, PTR_L, and SLF_L significantly differed between young and middle-age people. Therefore, we believe that these fibers could be used as image markers of age-related white matter changes.