The resistance of a ferromagnet/superconductor/ferromagnet (F/S/F) spin valve near its superconducting transition temperature, Tc, depends on the state of magnetization of the F layers. This phenomenon, known as spin switch effect (SSE), manifests itself as a resistance difference between parallel (RP ) and antiparallel (RAP ) configurations of the F layers. Both standard (RP > RAP ) and inverse (RP < RAP ) SSE have been observed in different superconducting spin valve systems, but the origin of the inverse SSE was not understood. Here we report observation of a coexistence of the standard and inverse SSE in Ni81Fe19/Nb/Ni81Fe19/Ir25Mn75 spin valves. Our measurements reveal that the inverse SSE arises from a dissipative flow of vortices induced by stray magnetic fields from magnetostatically coupled Néel domain wall pairs in the F layers.