This article focuses on the agronomic evaluation of the supplementation of mineral NPKMg fertilizers with elemental sulfur, magnesium, potassium, or ammonium sulfates in pot experiments with ryegrass growing in a sandy Arenosol with very low sulfur content. A benefit evaluation was carried out on the basis of biomass production, crop nutritional status, and changes in the content of soil organic matter fractions. Furthermore, the total number of bacteria, nitrogen-fixing bacteria, and fungi was estimated using the qPCR technique in soil samples after 60 days of ryegrass growth. The combined application of NPKMg and sulfur or sulfate fertilizers significantly increased the summary yield of three cuttings of fresh ryegrass biomass in the range of 32.3% to 82.7%. The application, especially in the form of sulfates, significantly decreased the content of free phenolic acids. Furthermore, compared to the control, i.e., soil with NPKMg applied alone, an increase in the content of glomalin-related proteins and a decrease in the amount of water-soluble organic carbon compounds were observed. Neither the number of DNA marker copy numbers of the total bacterial community nor the nitrogen-fixing bacteria were noticeably different. In turn, the total number of genetic markers for fungi was significantly higher in soils with potassium or ammonium sulfates compared to the control soil. The general results suggest that the application of sulfur fertilizers with NPKMg mineral fertilizer can benefit crops and support soil fertility due to the stabilization of aggregates and the decrease in water-soluble organic compounds.