India is agricultural country and Indian farmer select wide selection of fruit and vegetable crops. The cultivation of crops can be improved by the technological support. Fruits and vegetables losses are caused by disease. Diseases are seen on the leaves and fruits of plant, therefore disease detection plays a crucial role in cultivation of crops. Pathogens, fungi, microorganism, bacteria and viruses are sorts of fruit diseases also unhealthy environment is responsible for diseases. There are many techniques to spot diseases in fruits in its early stages. Hence, there's a requirement of automatic fruit unwellness detection system within the early stage of the unwellness. The aim is to detect the fruit disease, this method take input as image of fruit and determine it as infected or non- infected. The proposed method is based on the use of Scale-invariant Feature Transform (SIFT) Model with the desirable goal of accurate and fast classification of fruits. The SIFT features are local and based on the appearance of the object at particular interest points, and are invariant to image scale and rotation. They are also robust to changes in illumination, noise, and minor changes in viewpoint on image processing theory. SIFT have significant advantages because of their high accuracy, relatively easy to extract and allow for correct object identification with low probability of mismatch. Besides, they do not need an outsized number of coaching samples to avoid overfitting.