The preoperative diagnosis of brain tumor grades is important for therapeutic planning as it contributes to the tumors' prognosis. In the last few years, the development in the field of artificial intelligence and machine learning contributed greatly to the medical area, especially the diagnosis of the grades of brain tumors through radiological images and magnetic resonance images. In addition, one of the biggest challenges faced by a physician in the medical field is how to assess the accurate grade of glioma that is due to the complexity of tumor descriptors that appear on medical images. In this work, we applied a new ensemble learning method based on novel MRI features to build a new classification system for glioma grading. Specifically, we assess the discriminatory ability of the selected features, integrated with the new ensemble learning method called Ensemble Learning based on Adaptive Power Mean Combiner (EL-APMC). Then we evaluate and compare the performance of the EL-APMC algorithm with 21 classifier models that represent state-of-the-art machine learning algorithms. Results show that the EL-APMC algorithm achieved the best performance in terms of classification accuracy and F1-score metrics over the MRI Brain Tumor dataset called BRAT2015. In addition, we showed that the differences in classification results among 22 classifier models have statistical significance. We believe that the EL-APMC algorithm is an effective method for the classification in case of small-size datasets, which are common cases in medical fields. The proposed method provides an effective system for the classification of glioma with high reliability and accurate clinical findings.