Fabric shape retention is a crucial property that impacts the durability and usability of fabric and which needs a convenient and accurate evaluation method. In the previous research, the automated crease recovery testing method was used to obtain fabric crease recovery information and evaluate the property of shape retention. Based on the previous research, an orthogonal test method was adopted to investigate the effect of different test parameters on the stability of shape retention detection in this paper. First, three factors, that of sample size, pressure, and pressure time, and three different levels of each factor were determined by the L9(34) orthogonal test table. Next, the fabric shape retention indexes were detected by nine different test schemes, and the comprehensive score of shape retention index standard deviation was obtained as the evaluation criterion of the orthogonal test results. Finally, the optimal test scheme was determined by visual analysis and variance analysis. The results show that the sample size has a certain effect on the stability of shape retention indexes, while the pressure time and the pressure have no significant influence. The optimal test scheme is that the sample size is 30 cm × 30 cm, the pressure time is 60 s, and the pressure is 40 N. The test result measured by the optimal test parameters reveals excellent stability when the vertex angle standard deviation is 2.0°, the height standard deviation is 0.06 cm, and the shape retention area standard deviation is 0.16 cm2. This paper provides an experimental basis for improving the accuracy of fabric shape retention evaluation method.