Fatty liver disease (FLD), including nonalcoholic fatty liver disease (NAFLD) and alcoholic fatty liver disease (AFLD), is a serious chronic metabolic disease that affects a wide range of people. Lipid accumulation accompanied by oxidative stress and inflammation in the liver is the most important pathogenesis of FLD. The plant-based, high-fiber, and low-fat diet has been recommended to manage FLD for a long time. This review discusses the current state of the art into the effects, mechanisms, and clinical application of plant-based foods in NAFLD and AFLD, with highlighting related molecular mechanisms. Epidemiological evidence revealed that the consumption of several plant-based foods was beneficial to alleviating FLD. Further experimental studies found out that fruits, spices, teas, coffee, and other plants, as well as their bioactive compounds, such as resveratrol, anthocyanin, curcumin, and tea polyphenols, could alleviate FLD by ameliorating hepatic steatosis, oxidative stress, inflammation, gut dysbiosis, and apoptosis, as well as regulating autophagy and ethanol metabolism. More importantly, clinical trials confirmed the beneficial effects of plant-based foods on patients with fatty liver. However, several issues need to be further studied especially the safety and effective doses of plant-based foods and their bioactive compounds. Overall, certain plant-based foods are promising natural sources of bioactive compounds to prevent and alleviate fatty liver disease.