Waterlogging is becoming a severe and universal phenomenon in China, so the construction of sponge cities is proposed to address urban water problems abiding by the overall principles of ecological priority and low-impact development. The ecological security pattern (ESP) is an effective way to balance rapid urbanization and ecological protection. Taking Zhengzhou as an example, this study, performed a geographic information system (GIS) modeling, which constructed a targeted ESP for the construction of a sponge city based on comprehensive analysis of multi-factor water ecological sensitivity. Compared to previous studies of ESP, some improvements were made in the identification method of ecological sources, corridors, and nodes. By analyzing the ESP, the study divided the whole city into different construction zone. Through different protection and planning strategies for these areas, the integration and connectivity of the ecological sources can be improved, and thus, urban ecological security can be improved. The ESP for sponge city is a relatively more systematic and scientific way to guide the construction of a sponge city, and can be used for reference to other cities in the process of sponge city construction.