Anemia is a common complication of chronic kidney disease (CKD) and is associated with adverse patient outcomes. However, data on the prevalence of anemia in CKD patients is sparse, particularly in resource-limited settings. Therefore, this study aimed to assess the prevalence of anemia and its predictors among patients with CKD admitted to the Jimma medical center, southwest Ethiopia. A hospital-based prospective cross-sectional study was conducted from September 1 to November 30, 2020. All adult patients with CKD aged ≥18 years who fulfilled the inclusion criteria were consecutively recruited into the study. Data were entered into the Epi data manager version 4.4.1 and then exported to SPSS version 22 (IBM Corp., Armonk, NY) for analysis. The predictors of anemia were determined using multivariable logistic regression analysis. Statistical significance was set at P < .05. A total of 150 patients were included in this study. Of these, 64.67% were male, 56.67% had stage 5 CKD, 78% had a CKD duration of less than 1 year, and 74% had proteinuria. Hypertension (40.7%) and diabetes (14.7%) were the common causes of CKD. The prevalence of anemia was 85.33%. Of the patients, 28.67%, 40.67%, and 16% had mild, moderate, and severe anemia, respectively. On multivariate logistic regression, stage 4 CKD (adjusted odds ratio [AOR] 3.2, confidence interval [CI]: 1.78–12.91, P = .025), stage 5 CKD (AOR 4.03, CI: 1.17–13.73, P = .016), and CKD duration of less than 1 year (AOR 3, CI: 1.19–9.11, P = .007) were significantly associated with anemia. The prevalence of anemia among stage 3 to 5 CKD patients was very high. Anemia was significantly associated with the severity and duration of CKD. Therefore, serial follow-up of patients with a long duration and advanced stages of CKD may help prevent anemia and its adverse consequences.