Despite the many benefits associated with the utilization of superabsorbent polymers (SAPs), several drawbacks have been reported. In particular, the effect of SAPs on microstructure, together with its consequences for mechanical properties, is not fully understood yet for some composite materials. This study analyzes the role of SAPs in the formation of the microstructure of lime composites, taking into account their chemical composition. The obtained experimental results show that the particle size and cross-linking density of used SAPs are crucial parameters affecting both the microstructure and mechanical performance of the analyzed composites. Coarser SAPs with low cross-linking density in the dosage of 0.5 and 1 wt.% are found as the most suitable solution, leading even to a slight improvement of mechanical parameters. The secondary porosity formed by swelled hydrogels is identified as a very significant factor since hydrogel-filled voids do not contribute to the strength parameters. The formation of the affected zone around SAP cores depends on the chemical composition of SAPs considerably as the higher cross-linking density influences the desorption rate. Based on achieved results, utilization of SAPs in building materials should be studied at a more detailed level with particular importance on the definition of SAP-related voids and affected zone around SAP particles.