In this research study, arrhythmia classification was assessed by using Massachusetts Institute of Technology-Beth Israel Hospital (MIT-BIH) arrhythmia database. After signal acquisition, semantic feature extraction (combination of statistical, entropy, linear and non-linear features) was used for extracting the feature values from acquired electrocardiogram (ECG) signals. Here, twenty-six features were combined to perform feature extraction on acquired ECG signals. Then, the infinite feature selection was used for rejecting the irrelevant feature vectors or selecting the optimal feature subsets. After selecting the optimal feature vectors, a binary classifier: random forest was used to classify the eight arrhythmia heartbeat conditions: Normal sinus rhythm (N), Sinoauricular Heart Block (SHB), Premature Ventricular Contraction (PVC), Auricular Fibrillation (AF), Left Bundle Branch Block (LBBB), Premature Atrial Contraction (PAC), Supra-Ventricular-Tachycardia (SVT) and Right Bundle Branch Block (RBBB). This research work includes numerous advantages; earlier detection of arrhythmia diseases, assists clinicians during surgery, and cost efficient compared to the existing machine learning methodologies. The experimental outcome shows that the proposed methodology effectively distinguishes the heartbeat conditions by means of sensitivity, specificity, Negative Predictive Value (NPV), Positive Predictive Value (PPV) and accuracy. The proposed methodology enhances the classification accuracy up to 1.4-1.5% compared to the existing methodologies.