Background Chronic low back pain (CLBP) is a common and often disabling musculoskeletal condition. Yoga has been proven to be an effective therapy for chronic low back pain. However, there are still controversies about the effects of yoga at different follow-up periods and compared with other physical therapy exercises. Objective To critically compare the effects of yoga for patients with chronic low back pain on pain, disability, quality of life with non-exercise (e.g. usual care, education), physical therapy exercise. Methods This study was registered in PROSPERO, and the registration number was CRD42020159865. Randomized controlled trials (RCTs) of online databases included PubMed, Web of Science, Cochrane Central Register of Controlled Trials, Embase which evaluated effects of yoga for patients with chronic low back pain on pain, disability, and quality of life were searched from inception time to November 1, 2019. Studies were eligible if they assessed at least one important outcome, namely pain, back-specific disability, quality of life. The Cochrane risk of bias tool was used to assess the methodological quality of included randomized controlled trials. The continuous outcomes were analyzed by calculating the mean difference (MD) or standardized mean difference (SMD) with 95% confidence intervals (CI) according to whether combining outcomes measured on different scales or not.