Annual cereal and legume grain production is dependent on inorganic nitrogen (N) and other fertilizers inputs to resupply nutrients lost as harvested grain, via soil erosion/runoff, and by other natural or anthropogenic causes. Temperate-adapted perennial grain legumes, though currently non-existent, might be uniquely situated as crop plants able to provide relief from reliance on synthetic nitrogen while supplying stable yields of highly nutritious seeds in low-input agricultural ecosystems. As such, perennial grain legume breeding and domestication programs are being initiated at The Land Institute (Salina, KS, USA) and elsewhere. This review aims to facilitate the development of those programs by providing criteria for evaluating potential species and in choosing candidates most likely to be domesticated and adopted as herbaceous, perennial, temperate-adapted grain legumes. We outline specific morphological and ecophysiological traits that may influence each candidate's agronomic potential, the quality of its seeds and the ecosystem services it can provide. Finally, we suggest that perennial grain legume breeders and domesticators should consider how a candidate's reproductive biology, genome structure and availability of genetic resources will determine its ease of breeding and its domestication timeline.