Grain legumes play a significant role in smallholder farming systems in Africa because of their contribution to nutrition and income security and their role in fixing nitrogen. Biological Nitrogen Fixation (BNF) serves a critical role in improving soil fertility for legumes. Although much research has been conducted on rhizobia in nitrogen fixation and their contribution to soil fertility, much less is known about the distribution and diversity of the bacteria strains in different areas of the world and which of the strains achieve optimal benefits for the host plants under specific soil and environmental conditions. This paper reviews the distribution, characterization, and commercialization of elite rhizobia strains in Africa.