The effect of carbon content in the base metals of high-strength steel on the microstructure and impact toughness of simulated welding focusing on a coarse-grained heat-affected zone (CGHAZ) at different heat inputs was systematically investigated by using scanning electron microscopy (SEM) and electron back-scattering diffraction (EBSD). The Charpy impact test confirmed that there was an optimal heat input, which caused the CGHAZ to obtain the highest impact toughness. The optimal heat input is ~20 kJ/cm and remains unchanged with an increase in carbon content from 0.04 to 0.12 wt.%. However, the impact toughness of the CGHAZ decreases with the increase in carbon content at each heat input. Microstructure characterization showed that a CGHAZ with 0.04 wt.% carbon gradually changed from lath bainite (LB) to granular bainite (GB) with an increase in heat input, while it changed from lath martensite (LM) to LB and then to GB for a CGHAZ with 0.12 wt.% carbon. Although the density of high-angle grain boundaries (HAGBs) obtained at 20 kJ/cm in the high-carbon sample is higher than that of the low-carbon sample, its impact toughness is lower, which is related to the parallel structure of the lath bundles and the morphology the austenite penetration.