Intelligent monitoring approaches for long-term, real-time digitalization in structural health monitoring (SHM) are currently attracting significant interest. Among these, self-sensing cementitious composites stand out due to their easy preparation, cost-effectiveness, and excellent compatibility with concrete structures. However, the current research faces challenges, such as excessive conductive filler, difficulties in filler dispersion, and insufficient stress sensitivity and instability. This study presents a novel approach to these challenges by fabricating self-sensing cementitious sensors using silver nanoparticles (AgNPs), a new type of conductive filler. The percolation threshold of AgNPs in these materials was determined to be 0.0066 wt%, marking a reduction of approximately 90% compared to traditional conductive fillers. Moreover, the absorbance test with a UV spectrophotometer showed that AgNPs were well dispersed in an aqueous solution, which is beneficial for the construction of conductive pathways. Through various cyclic loading tests, it was observed that the self-sensing cementitious sensors with AgNPs exhibited robust pressure-sensitive stability. Additionally, their stress sensitivity reached 11.736, a value significantly surpassing that of conventional fillers. Regarding the conductive mechanism, when encountering the intricate environment within the cementitious material, AgNPs can establish numerous conductive pathways, ensuring a stable response to stress due to their ample quantity. This study provides a significant contribution to addressing the existing challenges in self-sensing cementitious materials and offers a novel reference for further research in this domain.