Chronic kidney disease is a global health issue that affects millions of people worldwide and causes significant social, economic, and medical issues. Several automated detection systems can diagnose chronic kidney disease. This paper proposes the recursive random forest feature selection (RFFS) based ensemble learning algorithm to diagnose chronic kidney diseases (CKD). In the decision point, decision tree-based classifiers are used. The accuracy and kappa scores are used to determine the classification results. According to the results of the proposed algorithm's performance analyses, the ensemble learning classifiers outperform other classifiers for classifying CKD. The proposed RFFS algorithm achieves 6%-40% improved prediction accuracy using the feature selection algorithm. Further, it attains 15%-39% of reduced mean square error. The performance metrics, precision, sensitivity, specificity, f1 score, and Jaccard scores, have been analysed and show greater results for the RFFS algorithm.