A predator–prey system with prey social behavior and generalized Holling III functional response: Role of predator‐taxis on spatial patterns

Abstract

In this paper, we investigate the intrinsic impact of the predator‐taxis coefficient on the formation of spatial patterns in a predator–prey system with prey social behavior subject to Neumann boundary conditions. By treating the predator‐taxis coefficient as a potential critical parameter for Turing bifurcation, we observe that the Turing pattern is fully captured by three distinct critical thresholds. Meanwhile, utilizing weakly nonlinear analysis and the amplitude equation, we establish the direction of Turing bifurcation. Our mathematical analysis reveals that the inclusion of the predator‐taxis coefficient in the predator–prey system may lead to the emergence of either subcritical or supercritical Turing bifurcation. Our numerical experiments confirm the theoretical findings and exhibit various spatial patterns with different values of predator‐taxis coefficients.