Phenolic acid-polysaccharide conjugates, produced in plant food and medicine processing, are thought to account for the α-glucosidase inhibitory activity of the final products. However, this speculation lacks experimental support because of the complexity of the plant system and the polysaccharide structure. In this study, with dextran (average molecular weight, 1000) as the skeleton, a gallic acid-dextran conjugate was synthesized and confirmed by ultraviolet, infrared, and nuclear magnetic resonance spectroscopic analysis for the first time. Furthermore, this gallic acid-dextran conjugate showed inhibition of α-glucosidase due to galloyl groups in a mixed competitive and noncompetitive inhibition mode, whose performance was superior to that of acarbose.