Type 2 diabetes mellitus (T2DM) is an increasing global public health concern, but its impact on the salivary proteome is still unclear. To evaluate the effect of glycemic levels in middle-aged and elderly individuals with T2DM on salivary proteomics, we compared the differences by liquid chromatography tandem mass spectrometry (LC–MS/MS). Unstimulated whole saliva samples from 8 T2DM patients with good glycemic control (G group, HbA1c <6.5%) and 16 patients with poor control (P group, HbA1c ≥6.5%) were analyzed by LC–MS/MS in the data-independent acquisition mode (Clinical register number: ChiCTR1900023582.). After functional annotation, cluster analysis and receiver operating characteristic (ROC) curve analysis were carried out to screen and evaluate candidate proteins. A total of 5,721 proteins were quantified, while 40 proteins differed significantly. In the P group, proteins involved in oxidative stress-related processes were upregulated, whereas proteins related to salivary secretion were downregulated. The combination of thioredoxin domain-containing protein 17, zymogen granule protein 16B, and FAM3 metabolism regulating signaling molecule D yielded an area under the curve of 0.917 which showed a robust ability to distinguish the P and G groups. In conclusion, poorly controlled hyperglycemia may affect salivary proteins through various pathways, including oxidative stress and glandular secretion. Furthermore, the differentially expressed proteins, especially the three proteins with the best differentiation, might serve as an anchor point for the further study of hyperglycemia and oral diseases.