Diseases affecting the Oryza Sativa (rice) plant result in substantial agricultural losses, leading to a decline in crop productivity by up to 25% and posing a significant threat to global food security. Hence, the rapid and accurate diagnosis of such diseases is paramount to ensure effective treatment and to enhance overall plant health. This has led to an increased interest among plant pathologists in developing reliable methods for identifying diseases in Oryza Sativa crops. In this study, an innovative disease classification model for the Oryza Sativa plant is proposed, leveraging the Optimal Adaptive Boosting Cascade Classifier (OABCC) and the efficient-artificial fish swarm optimization (EAFSO). A weighted image fusion technique is utilized in the pre-processing stage for image denoising, combining the outcomes of homomorphic filtering (HAF), Laplace filtering (LAF), and the Kuwahara Filter (KF). The diseased portions of the Oryza Sativa plant leaf are localized using the OABCC, while Soft Non-Maximum Suppression (SN-MS) is deployed to select the optimal detection box for each item. The LeNet model, bolstered with an atrous-convolution layer, is integrated into the OABCC for improved disease classification. Further enhancement in model accuracy is achieved through the application of the EAFSO optimization strategy. When applied to the OABCC-ATRLeNet model for rice disease classification, the EAFSO optimization strategy outperforms other strategies such as WSSO, CSO, AFSO, and PSO. This research underscores the potential of deep learning approaches for robust and accurate classification of plant diseases, contributing significantly to the efforts in securing global food resources.