Nowadays, several researchers are facing challenges on the prediction of diseases from the huge volume of medical databases. So, researchers are using data mining techniques like association rules, classification and clustering to address challenges. The physicians make the right decisions for successful diagnosis of various diseases by using the prediction. The existing work classifies the data to predict the certain diseases, but still it faces the difficulties due to overfitting in the training data. The main aim of this research work is to classify the Medical Data (MD) by developing the feature selection based approach in MD Classification as MDC. The irrelevant features are eliminated from the MD by using Recursive Feature Elimination (RFE) method, then ranked the features to reduce the computation cost of the proposed method. The ranked features from the RFE are given as input to the Fuzzy Neural Network (FNN) with Reinforcement Learning (RL), which is used for classification. The proposed RFE-FNN method has the accuracy of the 98.57%, 98.15% sensitivity, 98.64% specificity and 95.47% F-Measure in Heart disease dataset.