In this letter, an asymmetric spin wave scattering behaviors caused by vortex chirality are investigated in cross-shaped ferromagnetic system by using the micromagnetic simulations. In the system, four scattering behaviors are found, 1) asymmetric skew scattering, depending on the polarity of vortex core, 2) back scattering (reflection), depending on the vortex core stiffness, 3) side deflection scattering, depending on structural symmetry of the vortex circulation, and 4) geometrical scattering, depending on waveguide structure. The first and second scattering behaviors are attributed to nonlinear topological magnon spin Hall effect related to magnon spin-transfer torque effect, which has value for magnonic exploration and application.