Industrialization has resulted in a large number of industrial waste slags being produced, which severely pollute the environment. This urgently needs resourceful treatment. The objective of this paper is to investigate the preparation, performance, and cementation mechanism of a novel geopolymer backfill paste for goaf. We reused diverse industrial waste slags based on low-calcium silica–alumina precursors (two fly ashes FAI, FAII, and red mud RM), high-calcium-based slags (carbide slag CS, soda residue SR, briquette residue slag BRS, and granulated blast furnace slag GBFS), and two additives (gypsum powder GP and lime powder LP). The hardening of backfill pastes was investigated by analyzing the effects of FAI, GBFS, RM, and LP on physical and chemical performance. The cementation mechanism of the prepared backfill paste was revealed through morphology, mineralogy, and chemical products through the use of X-ray diffraction (XRD), scanning electron microscopy (SEM), energy dispersive spectroscopy (EDS), and Fourier transform infrared spectroscopy (FTIR). The results show that the prepared backfill paste incorporating various solid wastes (FAI, FAII, RM, CS, SR, GBFS, RBS, etc.) yields a 28-d compressive strength of 2.1 MPa (higher than the required value of 0.6 MPa) and a fluidity of 201 mm. Geopolymer gels (N,C)-A-S-H, calcium silicate hydrated C-S-H, and calcium aluminosilicate hydrated C-A-S-H gels serve as chemical cementers, whereas unreacted particles serve as physical filler skeletons. These findings provide an experimental and theoretical basis for the interchangeable use of various identical component solid wastes in backfill engineering materials.