In this work, we have studied the stochastic response of a single voltage-gated potassium ion channel to a periodic external voltage that keeps the system out-of-equilibrium. The system exhibits memory, resulting from time-dependent driving, that is reflected in terms of dynamic hysteresis in the current-voltage characteristics. The hysteresis loop area has a maximum at some intermediate voltage frequency and disappears in the limits of low and high frequencies. However, the (average) dissipation at long-time limit increases and finally goes to saturation with rising frequency. This raises the question: how diminishing hysteresis can be associated with growing dissipation? To answer this, we have studied the nonequilibrium thermodynamics of the system and analyzed different thermodynamic functions which also exhibit hysteresis. Interestingly, by applying a temporal symmetry analysis in the high-frequency limit, we have analytically shown that hysteresis in some of the periodic responses of the system does not vanish. On the contrary, the rates of free energy and internal energy change of the system as well as the rate of dissipative work done on the system show growing hysteresis with frequency. Hence, although the current-voltage hysteresis disappears in the high-frequency limit, the memory of the ion channel is manifested through its specific nonequilibrium thermodynamic responses.