Worldwide, plant diseases adversely influence both the quality and quantity of crop production. Thus, the early detection of such diseases proves efficient in enhancing the crop quality and reducing the production loss. However, the detection of plant diseases either via the farmers' naked eyes or their traditional tools or even within laboratories is still an error prone and time consuming process. The current paper presents a Deep Learning (DL) model with a view to developing an efficient detector of olive diseases. The proposed model is distinguishable from others in a number of novelties. It utilizes an efficient parameterized transfer learning model, a smart data augmentation with balanced number of images in every category, and it functions in more complex environments with enlarged and enhanced dataset. In contrast to the lately developed state-ofart methods, the results show that our proposed method achieves higher measurements in terms of accuracy, precision, recall, and F 1-Measure.