Many medicinal plants have been used traditionally in East Asia for the treatment of gastrointestinal disease and inflammation. The aim of this study was to evaluate the anti-inflammatory activity of 350 extracts (175 water extracts and 175 ethanol extracts) from 71 single plants, 97 mixtures of two plants, and seven formulations based on traditional medicine, to find herbal formulations to treat inflammatory bowel disease (IBD). In the in vitro screening, nitric oxide (NO), tumor necrosis factor (TNF)-α, and interleukin (IL)-6 levels were determined in LPS-treated RAW264.7 cells and the TNF-α induced monocyte-epithelial cell adhesion assay was used for the evaluation of the anti-inflammatory activity of the compounds. Dextran sulfate sodium (DSS)-induced colitis model and 2,4,6-trinitrobenzene sulfonic acid (TNBS)-induced colitis model were used to evaluate the therapeutic effect against IBD of the samples selected from the in vitro screening. KM1608, composed of Zingiber officinale, Terminalia chebula and Aucklandia lappa, was prepared based on the screening experiments. The oral administration of KM1608 significantly attenuated the severity of colitis symptoms, such as weight loss, diarrhea, and rectal bleeding, in TNBS-induced colitis. In addition, inflammatory mediators, such as myeloperoxidase, TNF-α, and IL-6 levels decreased in the lysate of colon tissues treated with KM1608. Collectively, KM1608 ameliorated colitis through the regulation of inflammatory responses within the colon, which indicated that KM1608 had potential for the treatment of IBD.