Facial expressions are one of the communication ways between humans and their behavior can be determined through their facial expressions. Recently computer technology has been used to identify the facial expressions of people in order to predict their intentions. It remains a challenge for facial expression recognition to extract discriminative features from training sets with few labels because most deep learning-based algorithms primarily rely on spatial information and large labels. In this paper, we propose a system to classify seven types of facial expressions (Angry, Sadness, Surprise, Happiness, Fear, Neutral, and Disgust) instead of six, as in most previous research. In the proposed system, machine learning algorithms with deep learning are used to increase classification accuracy based on removing some unimportant facial regions. The support vector machine (SVM) algorithm is trained to detect the eyes and mouth regions from the face depending on histogram-oriented gradient (HOG) which is used as a features extractor. Then, merge the eyes and mouth regions for each image to create a new form of an image. After that, five different types of images are generated from the merged image named (RGB, HSV, Gray, Binary, and YCbCr). The images are fed one by one into the convolution neural network (CNN) algorithm. Finally, the voting process is used to select the most predictive class. The proposed system has been tested on three different types of datasets (KDEF, JAFFE, and FER2013) and the prediction accuracy in the system has reached more than 98% in all used datasets. The conclusion is that eliminating unimportant regions impacts the results of the classification accuracy.