In this study, CaO-containing wastes from pulp and paper industries such as fly ash (FA) and calcined lime mud (LM) were utilized to neutralize and purify acidic wastewaters from the pickling processes in steel mills. The investigations were conducted by laboratory scale trials using four different batches of wastewaters and additions of two types of CaO-containing waste materials. Primary lime (PL), which is usually used for the neutralization, was also tested in the same experimental set up in the sake of comparison. The results show that these secondary lime sources can effectively increase the pH of the acidic wastewaters as good as the commonly used primary lime. Therefore, these secondary lime sources could be potential candidates for application in neutralization processes of industrial acidic wastewater treatment. Moreover, concentrations of metals (such as Cr, Fe, Ni, Mo and Zn) can decrease dramatically after neutralization by using secondary lime. The LM has a purification effect from the given metals, similar to the PL. Application of fly ash and calcined lime mud as neutralizing agents can reduce the amount of waste from pulp and paper mills sent to landfill and decrease the need for nature lime materials in the steel industry.