Although ginsenosides Rb1, Rb2, Rc, and Rd and ginseng extracts are shown to inhibit pancreatic lipase (PL) activity, the effects of the other ginsenosides, particularly the deglycosylated ones that are considered to show stronger biological activities than the glycosylated forms, are not clear. In this study, we observed the effects of various ginsenosides on PL activity. Results showed that the effects vary with each individual ginsenoside. Ginsenosides Rb1, Rd, Rg1, Rg3, and compound K significantly suppressed 43, 47, 75, and 55% of PL activity at the concentration of 100 μg/mL, respectively. Rg3 was discovered to be the most effective among various common ginsenosides, with a minimum effective concentration of 6.25 μg/mL. Ginsenosides F2 and Rf slightly enhanced PL activity. In addition, fermentation markedly enhanced the inhibitory effect of the ginseng root and ginseng berry, which might be attributed to the changes of ginsenoside profiles.