Modification of concrete with waste materials is an increasingly common process, and they are primarily used as a partial substitution for cement. In the case of inert or nearly inert additions according to EN 206, the effectiveness of such a modification mainly concerns ecological aspects and, only to a small extent, mechanical properties. This article analyses the effect of modifying cement concrete with waste limestone powder as a partial substitution for fine aggregate. The analysed waste arises as a result of the accumulation of dust produced during the initial preparation of aggregate for the production of hot mix asphalt (HMA). In order to analyse the effect of waste on compressive strength, an experimental design was prepared with variable substitution levels and variable water/cement ratios. Compressive strength tests were performed after 28 to 90 days. Statistical analysis of the results was performed. Microscopic evaluation of the fractures of the samples was carried out to clarify the mechanism of transition zone enhancement, which resulted in an increase of compressive strength of the composite.