Apple yield estimation using a smartphone with image processing technology offers advantages such as low cost, quick access and simple operation. This article proposes a distribution framework consisting of the acquisition of fruit tree images, yield prediction in smartphone client, data processing and model calculation in server client for estimating the potential fruit yield. An image processing method was designed including the core steps of image segmentation with R/B value combined with V value and circle-fitting using curvature analysis. This method enabled four parameters to be obtained, namely, total identified pixel area (TP), fitting circle amount (FC), average radius of the fitting circle (RC) and small polygon pixel area (SP). An individual tree yield estimation model on an ANN (Artificial Neural Network) was developed with three layers, four input parameters, 14 hidden neurons, and one output parameter. The system was used on an experimental Fuji apple (Malus domestica Borkh. cv. Red Fuji) orchard. Twenty-six tree samples were selected from a total of 80 trees according to the multiples of the number three for the establishment model, whereby 21 groups of data were trained and 5 groups of data were validated. The R 2 value for the training datasets was 0.996 and the relative root meansquared error (RRMSE) value 0.063. The RRMSE value for the validation dataset was 0.284.Furthermore, a yield map with 80 apple trees was generated, and the space distribution of the yield was identified. It provided appreciable decision support for site-specific management.