Recently, significant advances in modern medicine and therapeutic agents have been achieved. However, the search for effective antidiabetic drugs is continuous and challenging. Over the past decades, there has been an increasing body of literature related to the effects of secondary metabolites from botanical sources on diabetes. Plants-derived metabolites including alkaloids, phenols, anthocyanins, flavonoids, stilbenoids, saponins, tannins, polysaccharides, coumarins, and terpenes can target cellular and molecular mechanisms involved in carbohydrate metabolism. In addition, they can grant protection to pancreatic beta cells from damage, repairing abnormal insulin signaling, minimizing oxidative stress and inflammation, activating AMP-activated protein kinase (AMPK), and inhibiting carbohydrate digestion and absorption. Studies have highlighted many bioactive naturally occurring plants’ secondary metabolites as candidates against diabetes. This review summarizes the current knowledge compiled from the latest studies published during the past decade on the mechanism-based action of plants-derived secondary metabolites that can target various metabolic pathways in humans against diabetes. It is worth mentioning that the compiled data in this review will provide a guide for researchers in the field, to develop candidates into environment-friendly effective, yet safe antidiabetics.