Pancreatic fat is associated with obesity and type 2 diabetes mellitus (T2DM); however, the relationship between different types of pancreatic fat and diabetes status remains unclear. Therefore, we aimed to determine the potential of different types of pancreatic fat accumulation as a risk factor for T2DM in overweight or obese patients. In total, 104 overweight or obese patients were recruited from January 2020 to December 2022. The patients were divided into three groups: normal glucose tolerance (NGT), impaired fasting glucose or glucose tolerance (IFG/IGT), and T2DM. mDixon magnetic resonance imaging (MRI) was used to detect pancreatic fat in all three groups of patients. The pancreatic head fat (PHF), body fat (PBF), and tail fat (PTF) in the IFG/IGT group were 21, 20, and 31% more than those in the NGT group, respectively. PHF, PBF, and PTF were positively associated with glucose metabolic dysfunction markers in the NGT group, and inter-lobular fat volume (IFV) was positively associated with these markers in the IFG/IGT group. The areas under the receiver operating characteristic curves for PHF, PBF, and PTF (used to evaluate their diagnostic potential for glucose metabolic dysfunction) were 0.73, 0.73, and 0.78, respectively, while those for total pancreatic volume (TPV), pancreatic parenchymal volume, IFV, and IFV/TPV were 0.67, 0.67, 0.66, and 0.66, respectively. These results indicate that intra-lobular pancreatic fat, including PHF, PTF, and PBF, may be a potential independent risk factor for the development of T2DM. Additionally, IFV exacerbates glucose metabolic dysfunction. Intra-lobular pancreatic fat indices were better than IFV for the diagnosis of glucose metabolic dysfunction.