The prevalence of type 2 diabetes has been growing at an increasing rate worldwide. Dietary therapy is probably the easiest and least expensive method to prevent and treat diabetes. Previous studies have reported that coarse grains have anti‐diabetic effects. Although considerable efforts have been made on the anti‐diabetic function of different grains, the mechanisms of coarse grains on type 2 diabetes have not been systematically compared and summarized so far. Intestinal flora, reported as the main ‘organ’ of action underlying coarse grains, is an important factor in the alleviation of type 2 diabetes by coarse grains. Furthermore, microRNA (miRNA), as a new disease marker and ‘dark nutrient’, plays a likely influential role in cross‐border communication among coarse grains, intestinal flora, and hosts. Given this context, this article reviews several possible mechanisms for the role of coarse grains on diabetes, incorporating resistance to inflammation and oxidative stress, repair of insulin signaling and β‐cell dysfunction, and highlights the regulation of intestinal flora disorders and miRNAs expression, along with some novel insights. © 2022 Society of Chemical Industry.