Agriculture has a major role in the economic development of our country. Productive growth and high yield production of fruits is essential and required for the agricultural industry. Application of image processing has helped agriculture to improve yield estimation, disease detection, fruit sorting, irrigation and maturity grading. Image processing techniques can be used to reduce the time consumption and has made it cost efficient. In this paper, we have provided a survey to address these challenges using image processing techniques.