Nowadays, the most demanding and time consuming task in medical image processing is Brain tumor segmentation and detection. Magnetic Resonance Imaging (MRI) is employed for creating a picture of any part in a body. MRI provides a competent quick manner for analyzing tumor in the brain. This proposed framework contains different stages for classifying tumor like Preprocessing, Feature extraction, Classification, and Segmentation. Initially, T1-weighted magnetic resonance brain images are considered as an input for computational purpose. Median filter is proposed to optimize the skull stripping in MRI images. Abnormal brain tissues are extracted in low contrast, in addition to meticulous location of edges of affected tissue can be detected. Then, Discrete Wavelet Transform (DWT) and Histogram of Oriented Gradients (HOG) are performing feature extraction process. HOG is used for extracting the features like texture and shape. Then, Classification is performed through Machine learning categorization techniques via Random Forest Classifier (RFC), Support Vector Machine (SVM), and Decision Tree (DT). These classifiers classify the brain image as either normal or abnormal and the performance is analyzed by various parameters such as sensitivity, specificity and accuracy.