With the improvement of the intelligence degree of textile and garment industry, with the help of advanced information technology, using computer image recognition method to realize automatic fabric recognition, can improve the recognition accuracy and production efficiency to a great extent. At present, the common fabric recognition algorithms do not combine the basic properties of fabric, only consider its image features, so the recognition accuracy is low. In this paper, on the basis of predecessors' research put forward a kind of fabric recognition method in combination with the fabric properties, with the commonly used 12 kinds of natural fiber fabrics as samples, geometric measurement of fabric image was established, the quantitative analysis of impact resilience and drape of fabrics attribute two factors, and the fabric properties of parametric modeling, get the fabric properties of geometric measurement. The image measurement data were normalized and constructed by polynomial regression. The convolu-tional neural network (CNN) is trained to extract features adaptively according to image features. The fabric recognition model is constructed to learn the parameters of two fabric attributes and realize automatic fabric recognition. It can effectively improve the accuracy and efficiency of cloth recognition and meet the needs of practical applications.