The addition of ground olive stones in the manufacture of mortar bricks reduces their thermal conductivity coefficient and increases heat exchange insulation. So, it can improve energy efficiency and reduce the energy demand of buildings. This research analyzes, from other points of view, the economic, social and environmental impacts of the doping of GERO mortar bricks with ground olive stone in a percentage between 5% and 15% by volume of fine aggregate for use in building construction. The study focuses mainly on the region of Andalusia, Spain, where large quantities of olive stones are collected as waste from olive oil production. The economic analysis shows how the use of ground olive stones as a partial replacement of fine aggregate in mortar can generate significant savings and economic returns in the medium term (10–20 years) by reducing conventional energy consumption in heating and air conditioning installations. Finally, the Environmental Life Cycle Analysis shows that the use of ground olive stones in GERO perforated bricks reduces environmental impacts in the medium term. In summary, the research concludes that the doping of mortar bricks with ground olive stones can have a positive impact on the economy, society and the environment, and represents a sustainable and cost-effective alternative for the construction industry.