Dysregulation of nuclear and cytoplasmic O-linked β-N-acetylglucosamine (O-GlcNAc) cycling is implicated in a range of diseases including diabetes and cancer. This modification maintains cellular homeostasis by regulating several biological processes, such as cell signaling. This highly regulated cycle is governed by two sole essential enzymes, O-GlcNAc transferase and O-GlcNAcase that add O-GlcNAc and remove it from over a thousand substrates, respectively. Until recently due to lack of structural information, the mechanism of substrate recognition has eluted researchers. Here we review recent successes in structural characterization of these enzymes and how this information has illuminated key features essential for catalysis and substrate recognition. Additionally, we highlight recent studies which have used this information to expand our understanding of substrate specificity by each enzyme.