A detailed understanding of the molecular mechanisms whereby ubiquitin (Ub) recognizes enzymes in the Ub proteasome system is crucial for understanding the biological function of Ub. Many structures of Ub complexes have been solved and, in most cases, reveal a large structural epitope on a common face of the Ub molecule. However, owing to the generally weak nature of these interactions, it has been difficult to map in detail the functional contributions of individual Ub side chains to affinity and specificity. Here we took advantage of Ub variants (Ubvs) that bind tightly to particular Ub-specific proteases (USPs) and used phage display and saturation scanning mutagenesis to comprehensively map functional epitopes within the structural epitopes. We found that Ubvs that bind to USP2 or USP21 contain a remarkably similar core functional epitope, or “hot spot,” consisting mainly of positions that are conserved as the wild type sequence, but also some positions that prefer mutant sequences. The Ubv core functional epitope contacts residues that are conserved in the human USP family, and thus it is likely important for the interactions of Ub across many family members.