The widely spread chromium (Cr) contamination is rising environmental concerns, while the reutilization of agro-industrial by-products are also urgently demanded due to their potential risks. In this study, we prepared the integrated micro-electrolysis composites (IMC) through a facile one-pot method with red mud and rice straw. The effects of components relatively mass ratios as well as pyrolysis temperature were analyzed. The XRD, XPS, SEM, FTIR, and various techniques proved the IMC was successfully synthesized, which was also used to analyze the reaction mechanisms. In this study, the dosage of IMC, pH, adsorption time, and temperature of adsorption processes were explored, in the adsorption experiment of Cr(VI), dosage of IMC was 2 g/L (pH 6, 25 °C, and 200 rpm) for isothermal, while the concentration and contact time were also varied. According to the batch experiments, IMC exhibited acceptable removal capacity (190.6 mg/g) on Cr(VI) and the efficiency reached 97.74%. The removal mechanisms of adsorbed Cr(VI) were mainly elaborated as chemical reduction, complexation, co-precipitation, and physical adherence. All these results shed light on the facile preparation and agro-industrial by-products recycled as engineering materials for the heavy metals decontamination in wastewater.