With the increased use of reclaimed asphalt (RA), the ability of bituminous materials to resist fatigue cracking may face a decline mainly due to the aged reclaimed asphalt binder (RAB), especially when RA is used at higher rates and not sufficiently treated. In this study, the bulk scale (asphalt) and its subscale (mortar) were employed to evaluate the effect on fatigue resistance when a RAB is added, by considering three replacement rates: 0%, 40%, and 70% RAB. The fatigue testing of asphalt mixtures was carried out using a four-point bending (4PB) setup, while the mortars were tested using a new column-like geometry utilising a dynamic shear rheometer (DSR). The fatigue properties were further analysed using dissipated energy concepts. The aim of this study was, first, to assess whether the inclusion of a RAB can provide at least similar fatigue properties compared to an all-virgin mix, and second, to evaluate whether the proposed treatment is beneficial for the mixtures with a RAB. The asphalt tests revealed that the inclusion of a 40% RAB led to increased fatigue resistance, whereas the mortar tests showed that the inclusion of RAB has an inverse effect on fatigue life.