Fruits significantly impact everyday living, i.e., Citrus fruits. Numerous fruits have a solid nutritious value and are packed with multivitamins and trace components. Citrus fruits are delicate and susceptible to many diseases and infections. Many researchers have suggested deep and machine learning-based fruit disease detection and classification models. This research presents a precise fruit disease identification model based on context data fusion with Faster-CNN in an edge computing environment. The goal is to develop an accurate, efficient, and trustable fruit disease detection model, a critical component of autonomous food production in a robotic edge platform. This research examines and explores four different diseases of Citrus fruits using CNN deep learning models to be adopted as edge computing solutions. Identification of citrus diseases such as cankers black spot, greening, scab, melanosis, and healthy citrus fruits are implemented using the proposed sequential model without pruning, with pruning having different sparsity levels followed by post quantization. Through the transfer learning method, this model is optimized for the assignment of fruit disease detection employing visuals from two patterns: Near-infrared (NIFR) and RGB. Early and late data fusion techniques for integrating multi-model (NIFR and RGB) facts are evaluated. The accuracy obtained from the proposed model for the canker disease is 97%, scab 95%, melanosis 99%, Greening 97%, Black spot 97% and healthy 97%. In this paper, the results of the proposed model are compared and evaluated with the sparsity levels of 50–80%, 60–90%, 70–90%, and 80–90% pruning and also obtained the results of post-quantization on each level. The results show that the model size with 60–90% pruning can be counteracted to the 47.64 of the baseline model without significant loss of accuracy. Moreover, post-quantization can reduce the 60–90% pruning from 28.16 to 8.72. In addition to enhanced precision, the above initiative is much faster to implement for new fruit diseases because it needs bounding box annotation instead of pixel-level annotation.