Bacteria and other prokaryotes evolve primarily through rapid changes in their gene content by quickly losing and gaining genes whenever an ecological opportunity emerges. As gene loss and horizontal gene transfer (HGT) appear to be the most common events across the prokaryotic tree of life, we need to think beyond gradual sequence evolution if we wish to understand the microbial world. Especially genes that reside on mobile genetic elements (MGEs) may spread much more rapidly through a microbial population than genes that reside on the bacterial chromosome. This raises the question: why are some genes associated with MGEs, while others are not? Here, I briefly review a recently proposed class of genes for which we have coined the term “rescuable genes”. The fitness effect of carrying these genes is so small, either constantly or on average, that they are prone to be lost from a microbial population. I argue that HGT, even when costly to the individual cells, may play an important role in maintaining these rescuable genes in microbial communities.