Electrically conductive cementitious composite (ECCC) can be utilized in traffic detection, structural health monitoring (SHM), and pavement deicing. Graphite is a popular conductive filler given its outstanding electrical resistance behavior, but its flat micro‐surface decreases the friction resistance, reducing mechanical strength. However, slag solids can substitute part of the graphite with their considerable conductivity and superior mechanical characteristics. In this research, 27 ECCC composites are developed incorporated by combined graphite powder (GP), blast furnace slag (GGBS), and steel slag (SS). Flexural, unconfined compressive strength (UCS) experiments, and resistance experiments with failure mode evaluations are carried out to explore the influence of proposed conductive fillers with different fractions. Results show the graphite strongly improves conductivity but dramatically reduces mechanical performance. Both steel slag and GGBS reduced the compressive and flexural strength after their replacement ratio exceeded 20%. Additionally, compared with GGBS, SS demonstrated a better influence on mechanical and conductive performance. A 15 wt% ratio of GGBS, 20 wt% of SS, and 4 wt% of GP are explored as the optimum design with 3.4 MPa of flexural strength, 36 MPa of compressive strength, and 7,779 Ω cm of resistance. Lastly, a microstructural investigation is conducted to explore the mechanical and conductive mechanism of ECCC.