In the face of people’s growing spiritual civilization needs, the application of traditional art colors in modern visual communication design has become a hot spot of attention. In this paper, a model for extracting traditional art color features is constructed to provide a methodology and theory for applying traditional art color in modern visual communication design. In the model construction, the max-min clustering algorithm is proposed to achieve color segmentation, measure the distance between the clustering center and the samples, and improve computing speed. Based on the K-means algorithm, the initial clustering center selection and the number of class clusters are improved, and the color feature extraction method is optimized to improve the accuracy of color extraction. In the performance experiments of the model, the All, Noncc, and Disc parameters of this paper’s color segmentation algorithm are lower than those of other algorithms in color segmentation of different pictures, and the performance is good. The accuracy of the color feature extraction test in different color spaces is close to 100%, the average verification accuracy is as high as 99.8%, and it takes less time. The aesthetic, originality, symbolism, and spirituality evaluation indexes of the poster work “Lead,” designed by combining the model of this paper, have an average score of more than 4, which reaches a good level.