Composites with excellent thermomechanical and thermochemical properties are urgently needed in the aerospace field, especially for structural applications under high-temperature conditions. Carbon fiber-reinforced Si-based composites are considered the most promising potential high-temperature materials due to their excellent oxidation resistance and ablative behaviors, good structural designability, and excellent mechanical properties. The reinforcement of the relevant composites mainly involves carbon fiber, which possesses good mechanical and temperature resistance abilities. In this paper, the ablation behaviors and mechanisms of related composites are reviewed. For carbon fiber-reinforced pure Si-based composites (C/SiM composites), the anti-ablation mechanism is mainly attributed to the continuous glassy SiO2, which inhibits the damage of the substrate. For C/SiM composite doping with refractory metal compounds, the oxides of Si and refractory metal together protect the main substrate from ablation and oxidation. Moreover, in addition to thermochemical damage, thermophysical and thermomechanical behavior severely destroy the surface coating of the substrate.