In general, acid aggregates are not used in combination with asphalt concrete because of their poor compatibility with the asphalt binder, which typically results in a scarce water stability of the concrete. In the present study, the feasibility of a new approach based on the combination of acid granite fine aggregate with alkaline limestone coarse aggregate and Portland cement filler has been assessed. The mineral and chemical compositions of these three materials have first been analyzed and compared. Then, the effect of different amounts of Portland cement (0%, 25%, 50%, 75% and 100% of the total filler by weight) on the mechanical performance and water stability of the asphalt concrete has been considered. Asphalt concrete has been designed by using the Marshall method, and the mechanical performance indexes of this material, including the Marshall stability and indirect tensile strength (ITS), have been measured together with the related water stability indexes (namely the Marshall stability (RMS) and tensile strength ratio (TSR)). The results indicate that the alkaline limestone coarse aggregate and Portland cement filler can balance the drawback caused by the acid granite fine aggregate. The asphalt concrete has good mechanical performances and water stability when the amount of common limestone powder filler replaced by cement is not less than 75%.