Xanthogranulomatous inflammation is a rare benign condition involving various organs. However, its pancreas involvement is very rare. To the best of our knowledge, only 17 cases have been described in the literature. Interestingly, all reported 17 cases due to various causes underwent surgical resection. Here, we present a case of xanthogranulomatous pancreatitis in a 63-year-old man. He presented with epigastric pain and solid mass mimicking ductal adenocarcinoma in the body and tail of pancreas on magnetic resonance imaging. The patient was diagnosed as xanthogranulomatous pancreatitis via endoscopic ultrasound-guided fine needle aspiration. After that, he was followed up and monitored without any surgical treatment. Here, we show imaging findings and serial image changes of xanthogranulomatous pancreatitis for this case.