The massive stockpiling of electrolytic manganese residue (EMR) has caused serious environmental pollution. In this study, EMR, coal gangue (CG), and fly ash (FA) were used as raw materials to obtain the optimal mix ratio based on Design-Expert mixture design. The effects of activator modulus, liquid–solid (L/S) ratio, and curing temperature on the mechanical properties of geopolymers were investigated. The results showed that the compressive strength of the prepared geopolymer was 12.0 MPa, and the 28d leaching of Mn was 0.123 mg/L under the conditions of EMR:CG:FA = 0.43:0.34:0.23, L/S = 0.9, a curing temperature of 60 °C, and a curing time of 24 h. This indicates that the geopolymer is an environmentally friendly material with high compressive strength. The mineral composition of the geopolymer is mainly hydrated calcium silicate and geopolymer gel. In addition, a more stable new mineral phase, MnSiO3, was generated. The Fourier transform infrared (FTIR) spectrogram showed that the peak at 1100 m−1 was shifted to 1112 cm−1, which indicated that a geopolymerization reaction had occurred. Through scanning electron microscopy (SEM) and energy dispersive spectrum (EDS) analysis, it was identified that the geopolymerization produced a large amount of amorphous gelatinous substances with a relatively dense structure, the major elements being oxygen, silicon, aluminum, calcium, and sodium.