Visceral adiposity is known to be related to poor prognosis in patients with cholangiocarcinoma; however, the prognostic significance of the qualitative features of adipose tissue in cholangiocarcinoma has yet to be well defined. This study investigated the prognostic impact of adipose tissue imaging parameters reflecting the quantity and qualitative characteristics of subcutaneous (SAT) and visceral (VAT) adipose tissue on recurrence-free survival (RFS) and overall survival (OS) in 94 patients undergoing resection of cholangiocarcinoma. The area, mean computed tomography (CT) attenuation, and mean 2-deoxy-2-[18F]fluoro-D-glucose (FDG) uptake of SAT and VAT on positron emission tomography (PET)/CT for staging work-up were measured, and the relationship of these adipose tissue imaging parameters with clinicopathological factors and survival was assessed. TNM stage, histologic grade, lymphovascular invasion, and the size of cholangiocarcinoma showed positive correlations with adipose tissue imaging parameters. Multivariate survival analysis demonstrated that the visceral-to-subcutaneous adipose tissue area ratio (VSR) (p = 0.024; hazard ratio, 1.718) and mean FDG uptake of VAT (p = 0.033; hazard ratio, 9.781) were significant predictors for RFS, but all of the adipose tissue imaging parameters failed to show statistical significance for predicting OS. In addition to visceral adiposity, FDG uptake of VAT might be a promising prognostic parameter for predicting RFS in patients with cholangiocarcinoma.