Vanadium (V) pollution potentially threatens human health. Here, it is found that nsp1 and nsp2, Rhizobium symbiosis defective mutants of Medicago truncatula, are sensitive to V. Concentrations of phosphorus (P), iron (Fe), and sulfur (S) with V are negatively correlated in the shoots of wild‐type R108, but not in mutant nsp1 and nsp2 shoots. Mutations in the P transporter PHT1, PHO1, and VPT families, Fe transporter IRT1, and S transporter SULTR1/3/4 family confer varying degrees of V tolerance on plants. Among these gene families, MtPT1, MtZIP6, MtZIP9, and MtSULTR1;1 in R108 roots are significantly inhibited by V stress, while MtPHO1;2, MtVPT2, and MtVPT3 are significantly induced. Overexpression of Arabidopsis thaliana VPT1 or M. truncatula MtVPT3 increases plant V tolerance. However, the response of these genes to V is weakened in nsp1 or nsp2 and influenced by soil microorganisms. Mutations in NSPs reduce rhizobacterial diversity under V stress and simplify the V‐responsive operational taxonomic unit modules in co‐occurrence networks. Furthermore, R108 recruits more beneficial rhizobacteria related to V, P, Fe, and S than does nsp1 or nsp2. Thus, NSPs can modulate the accumulation and tolerance of legumes to V through P, Fe, and S transporters, ion homeostasis, and rhizobacterial community responses.