In order to explore the mechanism responsible for the interactions in the surfactant–polymer composite flooding and broaden the application range of the binary system in heterogeneous oil reservoirs, in this paper, the influences of different surfactants on the viscosity of two polymers with similar molecular weights, partially hydrolyzed polyacrylamide (HPAM) and hydrophobically modified polyacrylamide (HMPAM), were studied at different reservoir environments. In addition, the relationship between the surfactant–polymer synergistic effects and oil displacement efficiency was also investigated. The experimental results show that for HPAM, surfactants mainly act as an electrolyte to reduce its viscosity. For HMPAM, SDBS and TX-100 will form aggregates with the hydrophobic blocks of polymer molecules, reducing the bulk viscosity. However, zwitterionic surfactant aralkyl substituted alkyl sulfobetaine BSB molecules can build “bridges” between different polymer molecules through hydrogen bonding and electrostatic interaction. After forming aggregates with HMPAM molecules, the viscosity will increase. The presence of two polymers all weakened the surfactant oil–water interfacial membrane strength to a certain extent, but had little effect on the interfacial tension. The synergistic effect of the “bridge” between HMPAM and BSB under macroscopic conditions also occurs in the microscopic pores of the core, which has a beneficial effect on improving oil recovery.