In this paper, a nanocrystalline surface layer without impurities was fabricated on Ti-6Al-4V alloy by means of surface mechanical attrition treatment (SMAT). The grain size in the nanocrystalline layer is about 10 nm and grain morphology displays a random crystallographic orientation distribution. Subsequently, the low-temperature boriding behaviors (at 600 °C) of the SMAT sample, including the phase composition, microstructure, micro-hardness, and brittleness, were investigated in comparison with those of coarse-grained sample borided at 1100 °C. The results showed that the boriding kinetics could be significantly enhanced by SMAT, resulting in the formation of a nano-structured boride layers on Ti-6Al-4V alloy at lower temperature. Compared to the coarse-grained boriding sample, the SMAT boriding sample exhibits a similar hardness value, but improved surface toughness. The satisfactory surface toughness may be attributed to the boriding treatment that was carried out at lower temperature.