Pervious concretes, such as sustainable pavement materials, have great advantages in solving urban flooding, promoting urban ecological balance, and alleviating urban heat island effect, due to its special porous structure. However, pervious concrete typically has high porosity and low strength. The insufficient strength and poor freeze-thaw durability are important factors that restrict its wide application, especially in seasonal frozen areas. Improving the strength and freeze-thaw resistance of pervious concrete will expand its application. Silica fumes, as an industrial by-product waste and supplementary cementitious material, play an important role in improving concrete performance. The objective of this paper was to study the effects of silica fumes on properties of sustainable pervious concrete. Silica fumes were used to replace cement with the equivalent volume method at different levels (3%, 6%, 9%, and 12%). The control pervious concrete and silica fume-modified pervious concrete mixtures were prepared in the lab. The porosity, permeability, compressive strength, flexural strength, and freeze-thaw resistance properties of all mixtures were tested. The results indicated that the addition of silica fumes significantly improved the strength and freeze-thaw resistance of pervious concrete. The porosity and permeability of all pervious concrete mixtures changed little with the content of silica fumes due to the adoption of the equal volume replacement method.