Zinc could have a protective role against type 2 diabetes mellitus (T2DM). This systematic review and meta-analysis aimed to evaluate the association between dietary, supplementary, and total zinc intake, as well as serum/plasma and whole blood zinc concentration, and risk of T2DM. Observational studies, conducted on cases of incident diabetes or T2DM patients and healthy subjects that reported a measure of association between zinc exposure and T2DM, were selected. Random effects meta-analyses were applied to obtain combined results. Stratified meta-analyses and meta-regressions were executed to assess sources of heterogeneity, as well as the impact of covariates on the findings. From 12,136 publications, 16 studies were selected. The odds ratio (OR) for T2DM comparing the highest versus lowest zinc intake from diet was 0.87 (95% CI: 0.78–0.98). Nevertheless, no association between supplementary or total zinc intake from both diet and supplementation, and T2DM was observed. A direct relationship was found between serum/plasma zinc levels and T2DM (OR = 1.64, 95% CI: 1.25–2.14). A moderately high dietary zinc intake, in relation to the Dietary Reference Intake, could reduce by 13% the risk of T2DM, and up to 41% in rural areas. Conversely, elevated serum/plasma zinc concentration was associated with an increased risk of T2DM by 64%, suggesting disturbances in zinc homeostasis.