Graphene‐based materials (GBMs) possess a unique set of properties including tunable interlayer channels, high specific surface area, and good electrical conductivity characteristics, making it a promising material of choice for making electrode in rechargeable batteries. Lithium‐ion batteries (LIBs) currently dominate the commercial rechargeable battery market, but their further development has been hampered by limited lithium resources, high lithium costs, and organic electrolyte safety concerns. From the performance, safety, and cost aspects, zinc‐based rechargeable batteries have become a promising alternative of rechargeable batteries. This review highlights recent advancements and development of a variety of graphene derivative‐based materials and its composites, with a focus on their potential applications in rechargeable batteries such as LIBs, zinc‐air batteries (ZABs), zinc‐ion batteries (ZIBs), and zinc‐iodine batteries (Zn‐I2Bs). Finally, there is an outlook on the challenges and future directions of this great potential research field.