Increasing evidence suggests that the improper synaptic reconnection of regenerating axons is a significant cause of incomplete functional recovery following peripheral nerve injury. In this study, we evaluate the use of collagen hydrogels functionalized with two peptide glycomimetics of naturally occurring carbohydrates—polysialic acid (PSA) and human natural killer cell epitope epitope (HNK-1)—that have been independently shown to encourage nerve regeneration and axonal targeting. Our novel biomaterial was used to bridge a critical gap size (5 mm) in a mouse femoral nerve injury model. Functional recovery was assessed using gait and hind limb extension, and was significantly better in all glycomimetic peptide-coupled collagen conditions versus non-functional scrambled peptide-coupled collagen, native collagen, and saline controls. Analysis of cross-sections of the regenerated nerve demonstrated that hydrogels coupled with the PSA glycomimetic, but not HNK, had significant increases in the number of myelinated axons over controls. Conversely, hydrogels coupled with HNK, but not PSA, showed improvement in myelination. Additionally, significantly more correctly projecting motoneurons were observed in groups containing coupled HNK-1 mimicking peptide, but not PSA mimicking peptide. Given the distinct morphological outcomes between the two glycomimetics, our study indicates that the enhancement of recovery following peripheral nerve injury induced by PSA- and HNK-functionalized collagen hydrogels likely occurs through distinct mechanisms.