In order to achieve global carbon neutrality in the middle of the 21st century, efficient utilization of fossil fuels is highly desired in diverse energy utilization sectors such as industry, transportation, building as well as life science. In the energy utilization infrastructure, about 75% of the fossil fuel consumption is used to provide and maintain heat, leading to more than 60% waste heat of the input energy discharging to the environment. Types of low-grade waste heat recovery technologies are developed to increase the energy efficiency. However, due to the spatial and temporal mismatch between the need and supply of the thermal energy, much of the waste thermal energy is difficult to be recovered. Thermal energy storage (TES) technologies in the forms of sensible, latent and thermochemical heat storage are developed for relieving the mismatched energy supply and demand. Diverse TES systems are developed in recent years with the superior features of large density, long-term, durable and low-cost. These technologies are vital in efficient utilization of low-grade waste heat and expected for building a low or zero carbon emission society. This paper reviews the thermal storage technologies for low carbon power generation, low carbon transportation, low carbon building as well as low carbon life science, in addition, carbon capture, utilization, and storage are also considered for carbon emission reduction. The conclusion and perspective are raised after discussing the specific technologies. This study is expected to provide a reference for the TES technologies in achieving zero-carbon future.