A two‐step method pretreatment was used to optimize the phosphate conversion film on WE43 magnesium alloy. The surface status of the pretreatment layers and their effect on the formation processes of phosphate conversion films were investigated using scanning electron microscopy (SEM), X‐ray diffraction (XRD), and X‐ray photoelectron spectroscopy (XPS) analyses. It was found that the second phases on the grain boundaries of WE43 were dissolved completely by two‐step method pretreatment. The thin pretreatment film first flaked off in the phosphate process, resulting in a more uniform surface status. Then, the phosphate particles were deposited more homogeneously. Combined with the electrochemical impedance spectroscopy (EIS) and immersion test results, the optimized pretreatment greatly improved the compactness of the conversion films, further to enhance its protective ability to Mg substrate.