Secondary caries is one of the important issues related to using dental composite restorations. Effective prevention of cariogenic bacteria survival may reduce this problem. The aim of this study was to evaluate the antibacterial activity and physical properties of composite materials with silver sodium hydrogen zirconium phosphate (SSHZP). The antibacterial filler was introduced at concentrations of 1%, 4%, 7%, 10%, 13%, and 16% (w/w) into model composite material consisting of methacrylate monomers and silanized glass and silica fillers. The in vitro reduction in the number of viable cariogenic bacteria Streptococcus mutans ATCC 33535 colonies, Vickers microhardness, compressive strength, diametral tensile strength, flexural strength, flexural modulus, sorption, solubility, degree of conversion, and color stability were investigated. An increase in antimicrobial filler concentration resulted in a statistically significant reduction in bacteria. There were no statistically significant differences caused by the introduction of the filler in compressive strength, diametral tensile strength, flexural modulus, and solubility. Statistically significant changes in degree of conversion, flexural strength, hardness (decrease), solubility (increase), and in color were registered. A favorable combination of antibacterial properties and other properties was achieved at SSHZP concentrations from 4% to 13%. These composites exhibited properties similar to the control material and enhanced in vitro antimicrobial efficiency.