The endoplasmic reticulum (ER) serves as a warehouse for factors that augment and control the biogenesis of nascent proteins entering the secretory pathway. In turn, this compartment also harbors the machinery that responds to the presence of misfolded proteins by targeting them for proteolysis via a process known as ER-associated degradation (ERAD). During ERAD, substrates are selected, modified with ubiquitin, removed from the ER, and then degraded by the cytoplasmic 26S proteasome. While integral membrane proteins can directly access the ubiquitination machinery that resides in the cytoplasm or on the cytoplasmic face of the ER membrane, soluble ERAD substrates within the lumen must be retrotranslocated from this compartment. In either case, nearly all ERAD substrates are tagged with a polyubiquitin chain, a modification that represents a commitment step to degrade aberrant proteins. However, increasing evidence indicates that the polyubiquitin chain on ERAD substrates can be further modified, serves to recruit ERAD-requiring factors, and may regulate the ERAD machinery. Amino acid side chains other than lysine on ERAD substrates can also be modified with ubiquitin, and post-translational modifications that affect substrate ubiquitination have been observed. Here, we summarize these data and provide an overview of questions driving this field of research.