Leguminous plants are known to require phosphorus fertilizers and inoculation with nitrogen fixing rhizobia for optimum yield but other nutrients may also be lacking. In this study, the most limiting nutrients for legume growth were determined in soils where the crops had not responded to P and rhizobial inoculation in field trials, using the double pot technique. Soils were collected from 17 farmers' fields in West Kenya, Northern Nigeria, Eastern and Southern Rwanda, South-west and North-west Sierra Leone. Plant growth and mean biomass were measured on soils to which a full nutrient solution, containing phosphorus (P), potassium (K), magnesium (Mg), sulfur (S) and micronutrients (MN) were added, and which were compared to a control (no nutrient added), and individual omissions of each nutrient. The relationship between soil properties and nutrient deficiencies was explored. Nutrient limitations were found to differ between soils, both within and across countries. Generally, each soil was potentially deficient in at least one nutrient, with K, P, Mg, MN and S emerging as most limiting in 88, 65, 59, 18, and 12% of tested soils, respectively. While K was the most limiting nutrient in soils from Kenya and Rwanda, P was most limiting in soils from Nigeria. P and K were equally limiting in soils from Sierra Leone. Mg was found limiting in two soils from Kenya and three soils from Rwanda and one soil each in Nigeria and Sierra Leone. Micronutrients were found to be limiting in one soil from Nigeria and one soil from Rwanda. Estimates of nutrient deficiency using growth and mean biomass were found to be correlated with each other although the latter proved to be a more sensitive measure of deficiency. With few exceptions, the relation between soil parameters and nutrient deficiencies was weak and there were no significant relations between deficiency of specific nutrients and the soil content of these elements. Although our results cannot be translated directly to the field, they confirm that individual and multiple nutrient deficiencies were common in these “non-responsive” soils and may have contributed to reported low yields. This highlights the need for balanced nutrition in legume production in SSA.