For sparse system identification, a memory-improved proportionate affine projection sign algorithm with a simplified, generalized correntropy induced metric (SGCI-M-IPAPSA) has good filtering performance. However, the SGCI-M-IPAPSA is based on a fixed step size and is not always the best choice. To overcome the limitation of a fixed step size in filtering precision and convergence speed under non-Gaussian impulsive interferences, in this paper, we apply the combined-step-size idea and a variable-step-size method based on the mean-square deviation to the SGCI-M-IPAPSA, respectively, and propose two new robust algorithms to enhance the filtering performance of the SGCI-M-IPAPSA. In addition, by combining the combined-step-size and proposed variable-step-size methods, we propose a fresh combined variable-step-size way and apply it to the SGCI-M-IPAPSA. The convergence of the proposed algorithms is also elaborated, and a conditional decision on the mean-square error is used to cope with abrupt changes. The better performances of the proposed algorithms than the conventional SGCI-M-IPAPSA in terms of the filtering accuracy and convergence rate are demonstrated with non-Gaussian impulsive interferences for sparse system identification, abrupt changes and colored inputs.