Exercise is recommended as a first-line conservative intervention approach for osteoarthritis (OA). A wide range of exercise programs are available, and scientific evidence is necessary for advising patients with OA on the optimal treatment strategy. The purpose of this review is to discuss the effectiveness of different types of exercise programs for OA based on trials, systematic reviews, and meta-analyses in the literature. Publications from January 1997 to July 2012 were searched in 4 electronic databases using the terms osteoarthritis, exercise, exercise program, effectiveness, and treatment outcome. Strong evidence supports that aerobic and strengthening exercise programs, both land- and water-based, are beneficial for improving pain and physical function in adults with mild to moderate knee and hip OA. Areas that require further research include examination of the long-term effects of exercise programs for OA, balance training for OA, exercise programs for severe OA, the effect of exercise programs on progression of OA, the effectiveness of exercise for joint sites other than the knee or hip, and the effectiveness of exercise for OA by such factors as age, gender and obesity. Efforts to improve adherence to evidence-based exercise programs for OA and to promote the dissemination and implementation of these programs are crucial.