To a certain extent, automated fruit sorting systems reflect the degree of automated production in modern food industry, and boast a certain theoretical and application value. The previous studies mostly concentrate on the design of robot structure, and the control of robot motions. There is little report on the feature extraction of fruits in specific applications of fruit sorting. For this reason, this paper explores the target positioning and sorting strategy of fruit sorting robot based on image processing. Firstly, the authors constructed a visual sorting system for fruit sorting robot, and explained the way to recognize objects in three-dimensional (3D) scene and to reconstruct the spatial model based on sorting robot. Next, the maturity of the identified fruits was considered the prerequisite of dynamic sorting of fruit sorting robot. Finally, the program flow of the fruit sorting robot was given. The effectiveness of our strategy was verified through experiments.