Nonalcoholic fatty liver disease (NAFLD) is the most common cause of liver disease associated with various metabolic disorders. Metabolic dysfunction-associated fatty liver disease (MAFLD) emphasizes metabolic dysfunction in NAFLD. Although the relationship between NAFLD and colorectal adenomas has been suggested, the effect of MAFLD on colorectal adenoma has yet to be investigated. In this study, we examined the relationship between NAFLD/MAFLD and colorectal adenoma in comparison with other metabolic factors. Methods: Examinees who underwent colonoscopy and abdominal ultrasonography on the same day from January 2012 to December 2012 were included. NAFLD was diagnosed according to the findings of ultrasonography. The Fibrosis-4 (FIB-4) index was used as a surrogate marker for advanced hepatic fibrosis. A logistic regression model was used to analyze the risk of NAFLD/MAFLD for colorectal adenoma. Results: The prevalence of NAFLD and MAFLD was 37.5% and 32.8%, respectively. In the multivariate analysis, male sex, older age, diabetes, and smoking increased the risk of colorectal adenoma. NAFLD and MAFLD were the most important risk factors for colorectal adenoma only in females [adjusted odds ratio (OR) 1.43 and 95% confidence interval (CI) 1.01–2.03, and OR 1.55, 95% CI 1.09–2.20, respectively]. NAFLD and MAFLD with an advanced fibrosis index were significantly associated with an increased risk of colorectal adenoma. (NAFLD: OR 1.38, 95% CI, 1.04–1.83, p = 0.027; MAFLD: OR 1.45, 95% CI, 1.13–1.96, p = 0.004, respectively). Conclusion: NAFLD and MAFLD were significantly associated with a higher risk of colorectal adenomas, especially in females. NAFLD and MAFLD with advanced fibrosis were associated with an increased risk of colorectal adenoma. Colonoscopic examinations may be emphasized for patients with NAFLD/MAFLD, for women, or patients with the presence of hepatic fibrosis.