Background: Observational studies have indicated beneficial effects of whole grain consumption on human health. However, no evidence based on randomized controlled trials has been established. Our objective was to perform a systematic review and meta-analysis of randomized controlled trials to assess the effects of whole grain consumption in glycaemic control of diabetic patients. Methods: A comprehensive search in four databases (Web of Science, Pubmed, Scopus and Cochrane library) was conducted to collect potential articles which measured the roles of whole grain consumption on glycaemic control up to October 2021. Results: A total of 16 eligible trials involving 1068 subjects were identified to evaluate the pooled effect. The overall results indicated that compared with the control group, whole grain intake presented a significantly reduced concentration in fast plasma glucose (WMD = −0.51mmol/L, 95% CI: −0.73, −0.28; = 88.6%, p < 0.001), a homeostasis model assessment of insulin resistance (WMD = −0.39μU × mol/L2, 95% CI: −0.73, −0.04; = 58.4%, p = 0.014), and glycosylated haemoglobin (WMD = −0.56%, 95% CI: −0.88, −0.25, = 88.5%, p < 0.001), while no significant difference was observed in fast plasma insulin level between groups (SMD = −0.05, 95% CI: −0.25, 0.14; = 40.7%, p = 0.120). In terms of incremental area under the curve (iAUC), data suggested that whole grain effected a significant decrease in Glucose-iAUC (WMD = −233.09 min × mmol/L, 95% CI: −451.62, −14.57; = 96.1%, p < 0.001) and Insulin-iAUC (SMD = −4.80, 95% CI: −8.36, −1.23; = 89.9%, p = 0.002), although only in a small number of studies. Of note, there is evidence for modest unexplained heterogeneity in the present meta-analysis. Conclusion: Whole grain consumption confers a beneficial effect on glucose metabolism in patients with diabetes. Regrettably, since relevant studies were scarce, we failed to provide confident evidence of whole grain consumption on acute effects including Glucose-iAUC and Insulin-iAUC, which should be addressed in further trials.