The mouth is a first critical interface where most potentially harmful substances or pathogens contact the host environment. Adaptive and innate immune defense mechanisms are established there to inactivate or eliminate pathogenic microbes that traverse the oral environment on the way to their target organs and tissues. Protein and glycoprotein components of saliva play a particularly important role in modulating the oral microbiota and helping with the clearance of pathogens. It has long been acknowledged that glycobiological and glycoimmunological aspects play a pivotal role in oral host-microbe, microbe-host, and microbe-microbe interactions in the mouth. In this review, we aim to delineate how glycan-mediated host defense mechanisms in the oral cavity support human health. We will describe the role of glycans attached to large molecular size salivary glycoproteins which act as a first line of primordial host defense in the human mouth. We will further discuss how glycan recognition contributes to both colonization and clearance of oral microbes.