Protein phosphorylation is a modification that offers a dynamic and reversible mechanism to regulate the majority of cellular processes. Numerous diseases are associated with aberrant regulation of phosphorylation-induced switches. Phosphorylation is emerging as a mechanism to modulate ubiquitination by regulating key enzymes in this pathway. The molecular mechanisms underpinning how phosphorylation regulates ubiquitinating enzymes, however, are elusive. Here, we show the high conservation of a functional site in E2 ubiquitin-conjugating enzymes. In catalytically active E2s, this site contains aspartate or a phosphorylatable serine and we refer to it as the conserved E2 serine/aspartate (CES/D) site. Molecular simulations of substrate-bound and -unbound forms of wild type, mutant and phosphorylated E2s, provide atomistic insight into the role of the CES/D residue for optimal E2 activity. Both the size and charge of the side group at the site play a central role in aligning the substrate lysine toward E2 catalytic cysteine to control ubiquitination efficiency. The CES/D site contributes to the fingerprint of the E2 superfamily. We propose that E2 enzymes can be divided into constitutively active or regulated families. E2s characterized by an aspartate at the CES/D site signify constitutively active E2s, whereas those containing a serine can be regulated by phosphorylation.