Genes that participate in the degradation or isolation of glyphosate in plants are promising, for they endow crops with herbicide tolerance with a low glyphosate residue. Recently, the aldo-keto reductase (AKR4) gene in Echinochloa colona (EcAKR4) was identified as a naturally evolved glyphosate-metabolism enzyme. Here, we compared the glyphosate-degradation ability of theAKR4 proteins from maize, soybean and rice, which belong to a clade containing EcAKR4 in the phylogenetic tree, by incubation of glyphosate with AKR proteins both in vivo and in vitro. The results indicated that, except for OsALR1, the other proteins were characterized as glyphosate-metabolism enzymes, with ZmAKR4 ranked the highest activity, and OsAKR4-1 and OsAKR4-2 exhibiting the highest activity among the AKR4 family in rice. Moreover, OsAKR4-1 was confirmed to endow glyphosate-tolerance at the plant level. Our study provides information on the mechanism underlying the glyphosate-degradation ability of AKR proteins in crops, which enables the development of glyphosate-resistant crops with a low glyphosate residue, mediated by AKRs.