ClpXP, an AAA1 protease, plays key roles in protein-quality control and many regulatory processes in bacteria. The N-terminal domain of the ClpX component of ClpXP is involved in recognition of many protein substrates, either directly or by binding the SspB adaptor protein, which delivers specific classes of substrates for degradation. Despite very limited sequence homology between the E. coli and C. crescentus SspB orthologs, each of these adaptors can deliver substrates to the ClpXP enzyme from the other bacterial species. We show that the ClpX N domain recognizes different sequence determinants in the ClpX-binding (XB) peptides of C. crescentus SspBa and E. coli SspB. The C. crescentus XB determinants span 10 residues and involve interactions with multiple side chains, whereas the E. coli XB determinants span half as many residues with only a few important side chain contacts. These results demonstrate that the N domain of ClpX functions as a highly versatile platform for peptide recognition, allowing the emergence during evolution of alternative adaptor-binding specificities. Our results also reveal highly conserved residues in the XB peptides of both E. coli SspB and C. crescentus SspBa that play no detectable role in ClpX-binding or substrate delivery.