Mulberry (Morus alba) is a significant plant with numerous economic benefits; however, its growth and development are affected by nutrient levels. A high level of magnesium (Mg) or magnesium nutrient starvation are two of the significant Mg factors affecting plant growth and development. Nevertheless, M. alba’s metabolic response to different Mg concentrations is unclear. In this study, different Mg concentrations, optimal (3 mmol/L), high (6 mmol/L and 9 mmol/L), or low (1 and 2 mmol/L) and deficient (0 mmol/L), were applied to M. alba for three weeks to evaluate their effects via physiological and metabolomics (untargeted; liquid chromatography–mass spectrometry (LC-MS)) studies. Several measured physiological traits revealed that Mg deficiency and excess Mg altered net photosynthesis, chlorophyll content, leaf Mg content and fresh weight, leading to remarkable reductions in the photosynthetic efficiency and biomass of mulberry plants. Our study reveals that an adequate supply of the nutrient Mg promoted the mulberry’s physiological response parameters (net photosynthesis, chlorophyll content, leaf and root Mg content and biomass). The metabolomics data show that different Mg concentrations affect several differential metabolite expressions (DEMs), particularly fatty acyls, flavonoids, amino acids, organic acid, organooxygen compounds, prenol lipids, coumarins, steroids and steroid derivatives, cinnamic acids and derivatives. An excessive supply of Mg produced more DEMs, but negatively affected biomass production compared to low and optimum supplies of Mg. The significant DEMs correlated positively with mulberry’s net photosynthesis, chlorophyll content, leaf Mg content and fresh weight. The mulberry plant’s response to the application of Mg used metabolites, mainly amino acids, organic acids, fatty acyls, flavonoids and prenol lipids, in the KEGG (Kyoto Encyclopedia of Genes and Genomes) pathways. These classes of compounds were mainly involved in lipid metabolism, amino acid metabolism, energy metabolism, the biosynthesis of other secondary metabolites, the biosynthesis of other amino acids, the metabolism of cofactors and vitamin pathways, indicating that mulberry plants respond to Mg concentrations by producing a divergent metabolism. The supply of Mg nutrition was an important factor influencing the induction of DEMs, and these metabolites were critical in several metabolic pathways related to magnesium nutrition. This study provides a fundamental understanding of DEMs in M. alba’s response to Mg nutrition and the metabolic mechanisms involved, which may be critical to the mulberry genetic breeding program.