In the past decade, considerable attention has been focused on the measurement of glycemic markers, such as glycated hemoglobin and glycated albumin, that provide retrospective indices of average glucose levels in the bloodstream. While these biomarkers have been regularly used to monitor long-term glucose control in established diabetics, they have also gained traction in diabetic screening. Detection of such glycemic markers is challenging, especially in a point-of-care setting, due to the stringent requirements for sensitivity and robustness. A number of non-separation based measurement strategies were recently proposed, including photonic tools that are well suited to reagent-free marker quantitation. Here, we critically review these methods while focusing on vibrational spectroscopic methods, which offer highly specific molecular fingerprinting capability. We examine the underlying principles and the utility of these approaches as reagentless assays capable of multiplexed detection of glycemic markers and also the challenges in their eventual use in the clinic.