Agriculture is essential for the development of human civilization. Methods that can precisely estimate the yield of a crop or to perform the harvest automatically using robots can decrease the costs involved and increase production efficiency. With the advancement of agriculture 4.0, current technologies like the internet of things, big data, and artificial intelligence have become more and more common. Systems that use image processing with Deep Learning methods are becoming viable in solving agricultural problems. Deep Learning is part of a large family of methods based on artificial neural networks that can mimic the human brain's work in data processing and pattern recognition for decision-making. Indeed, applications of Deep Learning techniques in agriculture are relatively recent. However, with the rapid advance in Deep Learning and its successful application in agriculture, many articles have been published in recent years. Thus, the main objective of this work was to carry out a brief bibliographic review of pre-harvest fruit image processing techniques, emphasizing the most recent applications using Deep Learning. As seen in the literature, Deep Learning is a promising tool for various agricultural activities, including fruit counting and automatic fruit harvesting using robots.