Arbuscular mycorrhizal (AM) fungi engage in symbiosis with more than 80% of terrestrial plants, enlarging root phosphorus (P) absorption volume by producing extensive extraradical hyphae (ERH) in the soil. In addition, AM fungi recruit and cooperate with soil bacteria to enhance soil organic P mobilization and improve fungal and plant fitness through hyphal exudates. However, the role of the dominant compounds in the hyphal exudates in enhancing organic P mobilization in the mycorrhizal pathway is still not well understood. In this study, we added sugars, i.e., glucose, fructose, and trehalose, which are detected in the hyphal exudates, to the hyphal compartments (HCs) that allowed the ERH of the AM fungus to grow or not. The results showed that in AM fungus-inoculated pots, adding three sugars at a concentration of 2 mmol C kg−1 soil significantly increased the phosphatase activity and facilitated the mobilization of organic P in the HCs. The addition of fructose at a concentration of 2 mmol C kg−1 soil was the most efficient in increasing the phosphatase activity and enhancing organic P mobilization. The released inorganic P was then absorbed by the ERH of the AM fungus. The enhanced mobilization of organic P was correlated with the increase in phoD gene number and the changing bacterial community in the presence of fungal hyphae. The sugar addition enriched the relative abundance of some bacterial taxa, e.g., Betaproteobacteriales. Our study suggested that the addition of the sugars by mycorrhizae could be a pivotal strategy in managing P uptake in agricultural production, potentially directing future practices to optimize plant–fungi–bacteria interactions for improved P use efficiency.