Diabetes mellitus is a chronic metabolic disease relating to steady hyperglycemia resulting from the impairment of the endocrine and non-endocrine systems. Many new drugs having varied targets were discovered to treat this disease, especially type 2 diabetes. Among those, α-glucosidase inhibitors showed their effects by preventing the digestion of carbohydrates through their inhibition against α-amylase and αglucosidase. Recently, chalcones have attracted considerable attention as they have a simple structure, are easily synthesized as well as have a variety of derivatives. Some reports suggested that chalcone and its derivates could inhibit α-amylase and α-glucosidase. This narrative review provides a comprehensive evaluation of the inhibition of chalcone and its derivatives against α-amylase and α-glucosidase that were reviewed and reported in published scientific articles. Twenty-eight articles were reviewed after screening 207 articles found in four databases, including PubMed, Google Scholar, VHL (Virtual Health Library), and GHL (Global Health Library). This review presented the inhibitory effects of varied chalcones, including chalcones with a basic structural framework, azachalcones, bis-chalcones, chalcone oximes, coumarinchalcones, cyclohexane chalcones, dihydrochalcones, and flavanone-coupled chalcones. Many of these chalcones had significant inhibition against α-amylase as well as α-glucosidase that were comparable to or even stronger than standard inhibitors. This suggested that such compounds could be potential candidates for the discovery of new anti-diabetic remedies in the years to come.