Graphene oxide (GO) is a two-dimensional derivative of graphene material, with carboxy, hydroxy group functional groups at the middle of the sheets, and oxygen-containing functional groups at sheet edges. It has multiple advantages, such as high strength, hydrophilicity, and strong reactivity. With the development of construction materials, GO has been widely used as a nano-reinforced material in cement-based composites (CBCs). Based on a large amount of relevant literature, the preparation and dispersion behavior of GO-reinforced CBC are summarized. Besides, the impact of GO on the workability, volume stability, mechanical performance, and durability of CBC are discussed. Moreover, the influencing mechanism of GO on the hydration of CBC is expounded. From the findings of this review, the following conclusions can be drawn: the fluidity of CBC will be decreased when GO is evenly dispersed in the cement slurry, which results in a loss of workability of CBC. Meanwhile, the addition of GO improves the volume stability of CBC, while the tensile, compressive, and flexural strengths are all improved to varying degrees. The improvement of GO on the durability of CBC is mainly reflected in the corrosion resistance and permeability resistance. In addition, problems existing in the current research are summarized and future perspectives are put forward. The review work in this article could offer important guidance for further research and implementation of GO-doped CBC in practical engineering.