Background: This study aimed to evaluate the association between chronic low back pain (CLBP) and chronic diseases, such as hypertension, diabetes, and dyslipidemia. Methods: This study was a retrospective analysis using data from the Korea National Health and Nutrition Examination Survey (KNHANES) between 2010–2012 and included women who answered a questionnaire in the KNHANES asking whether they had low back pain for ≥3 months. Participants were divided into non-CLBP and CLBP groups. For statistical analysis, the Student’s t-test, chi-square test, Fisher’s exact test, and logistic regression analysis were performed using SPSS. Results: Of 5961 participants, the non-CLBP group comprised 4098 women and the CLBP group comprised 1863. Adjusted logistic regression model revealed that dyslipidemia was positively associated with CLBP (odds ratio, 1.32; 95% confidence interval, 1.140, 1.530; p < 0.001). However, hypertension and diabetes were not associated with CLBP. Conclusions: Our results suggest that proper treatment of dyslipidemia may contribute to lowering the risk of CLBP later in life.