The most rational method for identifying the quality of fruits is the optical method using PPE, which has the accuracy and stability of measurement, as well as distance and high productivity. The paper presents classification of fruit quality recognition systems and substantiates the design and technological scheme of the vision system for sorting them, consisting of an optical module with installed structural illumination and a video camera, an electronic control unit with an interface and actuators for the sorter and conveyor for fruits. In the course of the study, a single-stream type of fruit flow in PPE with forced rotation was substantiated, a structural and technological scheme of an STZ with a feeding conveyor, an optical module and a control unit, an algorithm for functioning of the STZ software was developed based on algorithm for segmentation of fruit colors, tracking algorithm, etc. deep learning ANN, which provide recognition of the size and color of fruits, as well as damage from mechanical stress, pests and diseases. The developed STZ has been introduced into the processing line for sorting and packing apples, LSP-4 has successfully passed preliminary tests and production tests at OJSC Ostromechevo. In the course of preliminary tests of the LSP-4 line, it was found that it provided fruit recognition with a probability of at least 95%, while the labor productivity made 2.5 t/h.