Using biomass for charcoal production in sub‐Saharan Africa (SSA) may change carbon stock dynamics and lead to irreversible changes in the carbon balance, yet we have little understanding of whether these dynamics vary by biome in this region. Currently, charcoal production contributes up to 7% of yearly deforestation in tropical regions, with carbon emissions corresponding to 71.2 million tonnes of CO2 and 1.3 million tonnes of CH4. With a projected increased demand for charcoal in the coming decades, even low harvest rates may throw the carbon budget off‐balance due to legacy effects. Here, we parameterized the dynamic global vegetation model LPJ‐GUESS for six SSA biomes and examined the effect of charcoal production on net ecosystem exchange (NEE), carbon stock sizes and recovery time for tropical rain forest, montane forest, moist savanna, dry savanna, temperate grassland and semi‐desert. Under historical charcoal regimes, tropical rain forests and montane forests transitioned from net carbon sinks to net sources, that is, mean cumulative NEE from −3.56 ± 2.59 kg C/m2 to 2.46 ± 3.43 kg C/m2 and −2.73 ± 2.80 kg C/m2 to 1.87 ± 4.94 kg C/m2 respectively. Varying charcoal production intensities resulted in tropical rain forests showing at least two times higher carbon losses than the other biomes. Biome recovery time varied by carbon stock, with tropical and montane forests taking about 10 times longer than the fast recovery observed for semi‐desert and temperate grasslands. Our findings show that high biomass biomes are disproportionately affected by biomass harvesting for charcoal, and even low harvesting rates strongly affect vegetation and litter carbon and their contribution to the carbon budget. Therefore, the prolonged biome recoveries imply that current charcoal production practices in SSA are not sustainable, especially in tropical rain forests and montane forests, where we observe longer recovery for vegetation and litter carbon stocks.