In the process of oilfield development, the surfactant–polymer (SP) composite system has shown significant effects in enhancing oil recovery (EOR) due to its excellent interfacial activity and viscoelastic properties. However, with the continuous increase in the volume of composite flooding injection, a decline in injection–production capacity (I/P capacity) has been observed. Through the observation of frozen core slices, it was found that during the secondary composite flooding (SCF) process, a large amount of residual oil in the form of intergranular adsorption remained in the core pores. This phenomenon suggests that the displacement efficiency of the composite flooding may be affected. Research has shown that polymers undergo flocculation reactions with clay minerals (such as kaolinite, Kln) in the reservoir, leading to the formation of high-viscosity mixtures of migrating particles and crude oil (CO). These high-viscosity mixtures accumulate in local pores, making it difficult to further displace them, which causes oil trapping and negatively affects the overall displacement efficiency of secondary composite flooding (SCF). To explore this mechanism, this study used a microscopic visualization displacement model (MVDM) and microscopy techniques to observe the migration of particles during secondary composite flooding. By using kaolinite water suspension (Kln-WS) to simulate migrating particles in the reservoir, the displacement effects of the composite flooding system on the kaolinite water suspension, crude oil, and their mixtures were observed. Experimental results showed that the polymer, acting as a flocculant, promoted the flocculation of kaolinite during the displacement process, thereby increasing the viscosity of crude oil and affecting the displacement efficiency of secondary composite flooding.