High heat input welding can improve welding efficiency, but the impact toughness of the heat-affected zone (HAZ) deteriorates significantly. Thermal evolution in HAZ during welding is the key factor affecting welded joints’ microstructures and mechanical properties. In this study, the Leblond–Devaux equation for predicting phase evolution during the welding of marine steels was parameterized. In experiments, E36 and E36Nb samples were cooled down at different rates from 0.5 to 75 °C/s; the obtained thermal and phase evolution data were used to construct continuous cooling transformation diagrams, which were used to derive the temperature-dependent parameters in the Leblond–Devaux equation. The equation was then used to predict phase evolution during the welding of E36 and E36Nb; the quantitative experimental phase fractions of the coarse grain zone were compared with simulated results to verify the prediction results, which are in good agreement. When heat input is 100 kJ/cm, phases in the HAZ of E36Nb are primarily granular bainite, whereas for E36, the phases are mainly bainite with acicular ferrite. When heat input increases to 250 kJ/cm, ferrite and pearlite form in both steels. The predictions agree with experimental observations.