In recent years, deep learning techniques are employed in the mammography processing field to reduce radiologists' costs. Existing breast mass classification systems are implemented using deep learning technologies such as a Convolutional Neural Network (CNN). CNN based systems have attained higher performance than the machine learning-based systems in the classification task of mammography images, but a few issues still exist. Some of these issues are; ignorance of semantic features, analysis limitation to the current patch of images, lost patches in less contrast mammography images, and ambiguity in segmentation. These issues lead to increased false information about patches of mammography image, computational cost, decisions based on current patches, and not recovering the variance of patches intensity. In turn, breast mass classification systems based on convolutional neural networks produced unsatisfactory classification accuracy. To resolve these issues and improve the accuracy of classification on low contrast images, we propose a novel Breast Mass Classification system named BMC. It has improved architecture based on a combination of k-mean clustering, Long Short-Term Memory network of Recurrent Neural Network (RNN), CNN, random forest, boosting techniques to classify the breast mass into benign, malignant, and normal. Further, the proposed BMC system is compared with existing classification systems using two publicly available datasets of mammographic images. Proposed BMC system achieves the sensitivity, specificity, F-measure, and accuracy for the DDSM dataset is 0.97%, 0.98%,0.97%, 0.96% and for the MIAS dataset is 0.97%, 0.97%,0.98%, and 0.95% respectively. Further Area Under Curve (AUC) rate of the proposed BMC system lies between 0.94% -0.97% for DDSM and 0.94%-0.98% for the MIAS dataset. The BMC method worked comparably better than other mammography classification schemes that have previously been invented. Moreover, the Confidence interval statistical test is also employed to determine the classification accuracy of the BMC system using different configurations and neural network parameters.INDEX TERMS Deep learning, convolutional neural network, random forest, breast mass classification, recurrent neural network, boosting, machine learning, mammograms, medical image processing.