Zn–air batteries (ZABs) are a promising technology; however, their commercialization is limited by challenges, including those occurring in the electrolyte, and thus, gel polymer electrolytes (GPEs) and hydrogels have emerged as substitutes for traditional aqueous electrolytes. In this work, PVA/PAA membranes were synthesized by the solvent casting method and soaked in 6 M KOH to act as GPEs. The thickness of the membrane was modified (50, 100, and 150 μm), and after determining the best thickness, the membrane was modified with synthesized SiO2 nanospheres and multi-walled carbon nanotubes (CNTs). SEM micrographs revealed that the CNTs displayed lengths of tens of micrometers, having a narrow diameter (95 ± 7 nm). In addition, SEM revealed that the SiO2 nanospheres had homogeneous shapes with sizes of 110 ± 10 nm. Physicochemical experiments revealed that SiO2 incorporation at 5 wt.% increased the water uptake of the PVA/PAA membrane from 465% to 525% and the ionic conductivity to 170 mS cm−1. The further addition of 0.5 wt.% CNTs did not impact the water uptake but it promoted a porous structure, increasing the power density and the stability, showing three-times-higher rechargeability than the ZAB operated with the PVA/PAA GPE.