Layered double hydroxides (LDHs) have a special structure and atom composition, which are expected to be an excellent electromagnetic wave (EMW) absorber. However, it is still a problem that obtaining excellent EMW-absorbing materials from LDHs. Herein, we designed heterostructure NiCo-LDHs@ZnO nanorod and then subsequent heat treating to derive NiCo@C/ZnO composites. Finally, with the synergy of excellent dielectric loss and magnetic loss, an outstanding absorption performance could be achieved with the reflection loss of − 60.97 dB at the matching thickness of 2.3 mm, and the widest absorption bandwidth of 6.08 GHz was realized at 2.0 mm. Moreover, this research work provides a reference for the development and utilization of LDHs materials in the field of microwave absorption materials and can also provide ideas for the design of layered structural absorbers.