The incorporation of recycled aggregates in concrete not only reduces the extraction of natural resources, but also decreases landfill disposal of construction and demolition waste. Hence, environmental impacts and costs are reduced, promoting the use of recycled aggregates and circular economy. However, the impacts of transport depend on the distance between facilities and longer distances may result in recycled aggregates being more costly and having larger environmental impact than natural aggregates. This paper discusses this topic, presents a review on the use of life cycle assessment methodology on natural and recycled aggregates for concrete, and applies this methodology in a real context pertaining the procurement of coarse aggregates to ready-mix concrete plants. A case study of two Portuguese regions, Coimbra and Lisbon, is presented. For each region, a quarry, a construction and demolition waste plant, and a ready-mix concrete plant are chosen and a comparative life cycle assessment is made. Different scenarios for the supply of natural and recycled aggregates are studied and the scenarios for recycled aggregates procurement include different hypotheses for the installation (construction and demolition waste plant or quarry) processing the construction and demolition waste into recycled aggregates. For this case study and both regions, it was found that the supply of recycled aggregates produced at the construction and demolition waste plant has lower environmental impact and cost than all other scenarios, including the provision of natural aggregates, except when it is assumed that the quarry is licensed and equipped for receiving unsorted construction and demolition waste and processing it into recycled aggregates. The paper shows that transport distance is a determining factor in the comparison of the impacts of the procurement of natural and recycled aggregates. Moreover, in the Portuguese context, the environmental impacts of the procurement of recycled aggregates may be smaller than those of natural aggregates, but cost may be larger for recycled aggregates, preventing that the most sustainable option is chosen.