Graphene, with its excellent properties and unique structure, has been extensively studied in the context of modifiable cement-based materials. However, a systematic summary of the status of numerous experimental results and applications is lacking. Therefore, this paper reviews the graphene materials that improve the properties of cement-based materials, including workability, mechanical properties, and durability. The influence of graphene material properties, mass ratio, and curing time on the mechanical properties and durability of concrete is discussed. Furthermore, graphene’s applications in improving interfacial adhesion, enhancing electrical and thermal conductivity of concrete, absorbing heavy metal ions, and collecting building energy are introduced. Finally, the existing issues in current study are analyzed, and the future development trends are foreseen.