A variety of co-existing impurities in phosphogypsum limit its large-scale and high-value utilization. This paper summarizes the common contents of major impurity components (silicon and phosphorus) and trace impurity components (fluorine, iron, aluminum, and carbon) in phosphogypsum and discusses the harm of impurity components to the comprehensive utilization of harmless phosphogypsum chemical resources. The occurrence status of impurity components in phosphogypsum and the research progress of various impurity removal technologies are summarized, and the effects of these impurity removal technologies on different contents of impurity components are evaluated. On this basis, the goal of improving the whiteness of phosphogypsum samples and the development of technology for further removal of impurities in phosphogypsum to improve the purity of the main content of calcium sulfate are speculated.