Significant increase in use of color dyes in modern society exerted a great pressure on environmental and water qualities. As such, studies for the removal of color dyes from water have been conducted extensively. In this study, common Earth materials dolomite and calcite were evaluated and contrasted for their removal of toluidine blue (TB), a cationic dye, before and after heat treatment. An increase by a factor of 3 in TB removal capacity from 3.5 to 10 mmol/kg was achieved after dolomite (Dol) was heated to 800 °C (designated as HDol). In contrast, the TB removal capacity increased by more than 100 times from 2 to 220 mmol/kg after calcite (Cal) was heated to 1000 °C (designated as HCal). For Dol and HDol, the TB removal increased as the solution’s pH increased but decreased with increases in the solution’s ionic strength. For Cal and HCal, the influence of the equilibrium solution’s pH and ionic strength on TB removal was negligible. The free energy of TB sorption on Dol, HDol, and Cal were −7 to −15 kJ/mol. The results suggested different removal mechanism for TB by Dol vs. Cal. X-ray diffraction data for Dol showed a slight increase in calcite content after heat treatment. For Cal, CaO was produced after heating, which converted back to calcite after 24 h of mixing with TB solutions. The significant TB removal by HCal could be attributed to its reaction with CaO. Thus, the best solution is to use freshly treated Cal for the removal of TB from solution.