Mid-rise reinforced concrete buildings are projected to continue being the predominant typology for urban development. Thus, reducing the carbon footprint of such buildings is critical for achieving a sustainable built environment. Reducing the amount of concrete and steel in a building through structural and mix design optimization is identified as a primary resource efficiency strategy. This paper is among the first to present evidence of the decarbonization potential of these dematerialization strategies on a building level. The study combines structural design choices such as slab system design, steel reinforcement optimization and span width with materials-based strategies, such as low binder concrete and low-carbon binders. For each scenario, material quantities are calculated following design prescriptions by EN1992–1–1 while state-of-the art life cycle inventory data are adopted to calculate the carbon footprint. Results show that shifting towards more efficient structural systems (i.e., waffle slab system) could save up to 20% of the carbon footprint on the building level compared to more traditional systems, such as slab on beams and flat slabs. In addition, reducing the spans from 7.5 to 5 m can save up to 20% more. Finally, the use of low-clinker cement in low-binder concrete can save another 50% in terms of CO2 impact per built-up area. Realistically, results of the case study concluded that implementing these three strategies could reduce the typical 232 kg CO2e/m2 value of the carbon footprint of structural elements of a mid-rise building up to only 58 kg CO2e/m2, i.e., a four-fold reduction.