Lithium-ion batteries (LIBs), used for energy supply and storage equipment, have been widely applied in consumer electronics, electric vehicles, and energy storage systems. However, the urgent demand for high energy density batteries and the shortage of lithium resources is driving scientists to develop high-performance materials and find alternatives. Low-volume expansion carbon material is the ideal choice of anode material. However, the low specific capacity has gradually become the shortcoming for the development of LIBs and thus developing new carbon material with high specific capacity is urgently needed. In addition, developing alternatives of LIBs, such as sodium ion batteries and potassium-ion batteries, also puts forward demands for new types of carbon materials. As is well-known, the design of high-performance electrodes requires a deep understanding on the working mechanism and the structural evolution of active materials. On this issue, ex-situ techniques have been widely applied to investigate the electrode materials under special working conditions, and provide a lot of information. Unfortunately, these observed phenomena are difficult to reflect the reaction under real working conditions and some important short-lived intermediate products cannot be captured, leading to an incomplete understanding of the working mechanism. In-situ techniques can observe the changes of active materials in operando during the charge/discharge processes, providing the concrete process of solid electrolyte formation, ions intercalation mechanism, structural evolutions, etc. Herein, this review aims to provide an overview on the characters of carbon materials in alkali ion batteries and the role of in-situ techniques in developing carbon materials.