Crops’ production and quality of yields are heavily affected by crop diseases which cause adverse impacts on food security as well as economic losses. In India, agriculture is a prime source of income in most rural areas. Hence, there is an intense need to employ novel and accurate computer vision-based techniques for automatic crop disease detection and their classification so that prophylactic actions can be recommended in a timely manner. In literature, numerous computer vision-based techniques by utilizing divergent combinations of machine learning, deep learning, CNN, and various image-processing techniques along with their associated merits and demerits have already been discussed. In this study, we systematically reviewed recent research studies undertaken by a variety of scholars and researchers of fungal and bacterial plant disease detection and classification and summarized them based on vital parameters like type of crop utilized, deep learning/machine learning architecture used, dataset utilized for experiments, performance matrices, types of disease detected and classified, and highest accuracy achieved by the model. As per the analysis carried out, in the category of machine learning-based approaches, 70% of studies utilized real-field plant leaf images and 30% utilized laboratory condition plant leaf images for disease classification while in the case of deep learning-based approaches, 55% studied employed laboratory-conditioned images from the PlantVillage dataset, 25% utilized real-field images, and 20% utilized open image datasets. The average accuracy attained with deep learning-based approaches is quite higher at 98.8% as compared to machine learning-based approaches at 92.2%. In the case of deep learning-based methods, we also analyzed the performances of pretrained and training from scratch models that have been utilized in various studies for plant leaf disease classification. Pretrained models perform better with 99.64% classification accuracy compared to training from scratch models which achieved 98.64% average accuracy. We also highlighted some major issues encountered in the computer vision-based disease detection and classification approach used in literature and provided recommendations that will help and guide researchers to explore new dimensions in crop disease recognition.