The shear creep characteristics of the contact surface between the permafrost and the structure play an important role in the study of the law of deformation and the measures for the prevention and control of pile foundations. In order to study the creep law and the development tendency of the contact surface between permafrost and concrete, it is necessary to establish an accurate creep model. In this study, based on the Nishihara model, a nonlinear element and damage factor D were introduced to establish an intrinsic model of permafrost-concrete contact surfaces considering the effect of shear stress. Creep tests with graded loading of concrete and frozen silt with different roughness at -1°C were conducted using a large stress-controlled shear apparatus. The adequacy of the model was checked using the test data and the regularity of the parameters of the model was investigated. The results show that the creep curves of the contact surface obtained with the improved Nishihara model agree well with the test results and can better describe the whole process of creep of the contact surface of frozen concrete. The analysis of the experimental data shows that: the roughness of the concrete has an inhibiting effect on the creep deformation of the contact surface, When the roughness R varies from 0 mm to 1.225 mm, the specimen corresponds to a long-term strength of 32.84 kPa to 34.57 kPa. For the same roughness and creep time, the creep deformation of the contact surface is more significant with the increasing shear stress τ. The results of the study can provide a theoretical basis for the design and numerical simulation of pile foundations in permafrost regions.