Aqueous zinc-ion batteries (ZIBs) represent an attractive choice for energy storage. However, ZIBs suffer from dendrite growth and an irreversible consumption of Zn metal, leading to capacity degradation and a low lifetime. In this work, a zinc–alginate (ZA) hydrogel–polymer electrolyte (HGPE) with a non-porous structure was prepared via the solution-casting method and ion displacement reaction. The resulting ZA-based HGPE exhibits a high ionic conductivity (1.24 mS cm−1 at room temperature), excellent mechanical properties (28 MPa), good thermal and electrochemical stability, and an outstanding zinc ion transference number (0.59). The ZA-based HGPE with dense structure is proven to benefit the prevention of the uneven distribution of ion current and facilitates the reduction of excessive interfacial resistance within the battery. In addition, it greatly promotes the uniform deposition of zinc ions on the electrode, thereby inhibiting the growth of zinc dendrites. The corresponding zinc symmetric battery with ZA-based HGPE can be cycled stably for 800 h at a current density of 1 mA cm−2, demonstrating the stable and reversible zinc plating/stripping behaviors on the electrode surfaces. Furthermore, the quasi-solid-state ZIB with zinc, ZA-based HGPE, and Ca0.24V2O5 (CVO) as the anode, electrolyte, and cathode materials, respectively, show a stable cyclic performance for 600 cycles at a large current density of 3 C (1 C = 400 mA g−1), in which the capacity retention rate is 88.7%. This research provides a new strategy for promoting the application of the aqueous ZIBs with high performance and environmental benignity.