Production of public goods in biological systems is often a collaborative effort that may be detrimental to the producers. It is therefore sustainable only if a small fraction of the population shoulders the cost while the majority reap the benefits. We modelled this scenario using Escherichia coli populations producing colicins, an antibiotic that kills producer cells’ close relatives. Colicin expression is a costly trait, and it has been proposed that only a small fraction of the population actively expresses the antibiotic. Colicinogenic populations were followed at the single-cell level using time-lapse microscopy, and showed two distinct, albeit dynamic, subpopulations: the majority silenced colicin expression, while a small fraction of elongated, slow-growing cells formed colicin-expressing hotspots, placing a significant burden on expressers. Moreover, monitoring lineages of individual colicinogenic cells showed stochastic switching between expressers and non-expressers. Hence, colicin expressers may be engaged in risk-reducing strategies—or bet-hedging—as they balance the cost of colicin production with the need to repel competitors. To test the bet-hedging strategy in colicin-mediated interactions, competitions between colicin-sensitive and producer cells were simulated using a numerical model, demonstrating a finely balanced expression range that is essential to sustaining the colicinogenic population.