Glycosylation has a strong impact on the chemical and physical properties of proteins and on their activity. The heterogeneous nature of this modification complicates the elucidation of the role of each glycan, thus slowing down the progress in glycobiology. Nevertheless, the great advances recently made in protein engineering and in the chemical synthesis, and semisynthesis of glycoproteins are giving impulse to the field, fostering important discoveries. In this review, we report on the findings of the last two decades on the importance that the attachment site, linkage, and composition of short glycans have in affecting protein properties and functions.