World’s second most occurring cancer is breast cancer. Prediction of disease is one of the most challenging tasks and there are many factors that effect this type of diagnosis like the ability of visual perception. This paper proposed a Convolutional Neural Network (CNN) based proper method for analyzing the earliest signs of breast cancer with the help of mammogram images. The main goal of proposed system is to identify the disease of breast cancer at early stages. Due to this reason, Mammographic image analysis society (MIAS) dataset is used. There are three hundred & twenty two (322) mammograms in the dataset, with 209 images of normal breasts and 133 images of abnormal breasts. While abnormal breasts are further classified as benign (62 images) and malignant (51 images). To implement this system, python library Keras and Tensor Flow libraries are used along with deep learning model CNN. Convolutional Neural Network (CNN) has been shown to be effective in detecting breast cancer in mammography images with 70% accuracy rate, according to promising testing data. The proposed system will enable the radiologist in detecting breast cancer in early stages.