Stability and Coexistence of a Diffusive Predator-Prey System with Nonmonotonic Functional Response and Fear Effect

Abstract

This paper investigates the diffusive predator-prey system with nonmonotonic functional response and fear effect. Firstly, we discussed the stability of the equilibrium solution for a corresponding ODE system. Secondly, we established a priori positive upper and lower bounds for the positive solutions of the PDE system. Thirdly, sufficient conditions for the local asymptotical stability of two positive equilibrium solutions of the system are given by using the method of eigenvalue spectrum analysis of linearization operator. Finally, the existence and nonexistence of nonconstant positive steady states of this reaction-diffusion system are established by the Leray–Schauder degree theory and Poincaré inequality.