Low carbon bainitic steel (LCBS) with excellent combined properties is the first choice for materials of pipeline transiting geological disaster. However, welding will worsen its toughness. In this paper, three kinds of welding heat input were designed to study the relationship between the toughness and microstructure in the coarse grain zone of welding heat affect zone (CGHAZ) of LCBS. The evolution characteristics of the microstructure of LCBS and the CGHAZ, and impact fracture were investigated by optical microscopy (OM), scanning electron microscopy (SEM). The results indicated that microstructure of LCBS consists mainly of bainite ferrite (BF) and granular bainite (GB). Heat input for 22 kJ/cm, the original austenite grains become coarsening, the microstructure is a small amount of quasi polygonal ferrite (QF) and polygonal ferrite (PF), which exhibits low Charpy impact toughness. However, for heat input of 19 kJ/cm, the degree of grain coarsening is small and distribution of martensite-austenite (M-A) constituents is the chain. The statistics of image software show that with the increase of heat input (16–22 kJ/cm), the average grain size of original austenite is basically the same (25 um), which is mainly due to Nb solute drag restraint the growth of austenite grain.