In this study, the effects of graphene oxide (GO) on the microstructure of cement mortars were studied using scanning electron microscopy (SEM), thermogravimetric (TG), and X-ray diffraction (XRD) techniques. Cement mortar samples with different proportions of GO (0.02, 0.04, 0.06, and 0.08 wt % based on the weight of cement) were prepared. The test results showed that GO affected the crystallization of cement hydration products, C–S–H (calcium silicate hydrate is the main hydrate product) and CH (calcium hydroxide). The morphology of hydration products changed with the increase of GO content. Furthermore, the results of XRD analyses showed that the diffraction peak intensity and the crystal grain size of CH (001), (100), (101), and (102) for GO samples increased considerably compared with the control sample. Based on the results, it can be understood that GO can modify the crystal surface of CH, leading to the formation of larger crystals.