Abstract-Accurate detection as well as classification of the breast cancer is still an unsolved question in the medical image processing techniques. We reviewed the existing Computer Aided Diagnosis (CAD)-based techniques to find that there has been enough work carried out towards both detection as well as classification of the breast cancer; however, all the existing techniques were implemented in highly controlled research environment. The prime contribution of this paper is it reviews some of the significant journals published during 2005-2016 and discusses its effectiveness thoroughly. The paper finally discusses about the open research issues that require a serious attention from the research community in order to address the existing issues. At the end, the paper makes some suggestion for carrying out future work direction in order to bridge the research gap explored from the existing system.