Artificial neural networks (ANNs) are applied in engineering and certain medical fields. ANN has immense potential and is rarely been used in breast lesions. In this present study, we attempted to build up a complete robust back propagation ANN model based on cytomorphological data, morphometric data, nuclear densitometric data, and gray level co-occurrence matrix (GLCM) of ductal carcinoma and fibroadenomas of breast cases diagnosed on fine-needle aspiration cytology (FNAC). We selected 52 cases of fibroadenomas and 60 cases of infiltrating ductal carcinoma of breast diagnosed on FNAC by two cytologists. Essential cytological data was quantitated by two independent cytologists (SRM, PD). With the help of Image J software, nuclear morphomeric, densitometric, and GLCM features were measured in all the cases on hematoxylin and eosin-stained smears. With the available data, an ANN model was built up with the help of Neurointelligence software. The network was designed as 41-20-1 (41 input nodes, 20 hidden nodes, 1 output node). The network was trained by the online back propagation algorithm and 500 iterations were done. Learning was adjusted after every iteration. ANN model correctly identified all cases of fibroadenomas and infiltrating carcinomas in the test set. This is one of the first successful composite ANN models of breast carcinomas. This basic model can be used to diagnose the gray zone area of the breast lesions on FNAC. We assume that this model may have far-reaching implications in future.