Local post-weld heat treatment is used to reduce welding residual stresses. The existing standards have great differences in the selection of the width of the heated band, and the heating width, as an important control parameter of the local heat treatment, will directly affect the quality of the heat treatment. In this paper, the numerical simulation method is used to simulate the welding and heat treatment process of unequal-thickness joints. The stress and deformation of the joint with different thickness ratios under different heating widths are studied by finite element simulation, focusing on the influence of the width of the heated band on the residual stress relief of the joint. Based on these studies, the criteria for determining the optimal width of the heating zone are consistent. Finally, the formula HB=HB1+HB2=3RT+1+k2RT for calculating local heat treatment heating width based on the thickness of welded joint for SA738Gr.B steel is established. Among them, HB1 is the width of the main heating zone, HB2 is the width of the auxiliary heating zone, k is the thickness ratio of the thick plate to the thin plate, and t is the wall thickness of the thin plate.