The different cultivars of apricot seeds may differ in their properties. To ensure economical and efficient seed processing, knowledge of the cultivars’ composition and physical properties may be necessary. Therefore, the correct identification of the cultivar of the apricot seeds may be very important. The objective of this study was to develop models based on selected textures of apricot seed images to distinguish different cultivars. The images of four cultivars of apricot seeds were acquired using a flatbed scanner. For each seed, approximately 1600 textures from the image, converted to the different color channels R, G, B, L, a, b, X, Y, and Z, were calculated. The models were built separately for the individual color channels; the color spaces Lab, RGB, XYZ; and all color channels combined based on selected texture parameters using different classifiers. The average accuracy of the classification of apricot seeds reached 99% (with an accuracy of 100% for the seeds of the cultivars ‘Early Orange’, ‘Bella’, and ‘Harcot’, and 96% for ‘Taja’) in the case of the set of textures selected from the color space Lab for the model built using the Multilayer Perceptron classifier. The same classifier produced high average accuracies for the color spaces RGB (90%) and XYZ (86%). For the set of textures selected from all color channels, i.e., R, G, B, L, a, b, X, Y, and Z, the average accuracy reached 96% (Multilayer Perceptron and Random Forest classifiers). In the case of individual color channels, the highest average accuracy was up to 91% for the models built based on a set of textures selected from color channel b (Multilayer Perceptron). The results proved the possibility of distinguishing apricot seed cultivars with a high probability using a non-destructive, inexpensive, and objective procedure involving image analysis.