Soil surface roughness is an important factor affecting hydrology and soil erosion processes, and its development is influenced by precipitation, topography, and tillage practices. In this study, the typical mollisol area in northeast China was taken as the research object. Then, the variation in soil surface roughness with time was analyzed under different terrains, as well as different tillage methods, and the effect of the precipitation condition on roughness was also discussed in detail. Through the design of field experiments, the height information of the soil surface was measured using a probe-type roughness plate. Two parameters, the root-mean-square height (RMSH) and the correlation length (CL), were selected to quantitatively characterize the soil surface roughness. In addition, the dynamic change patterns of surface roughness resulting from five tillage methods, including rotary tillage, combined tillage, no tillage, conventional tillage, and reduced tillage, under both sloping and flat land, were compared and analyzed throughout the soybean growing season, under the influence of rainfall. The results show that with the increase in rainfall, the RMSH of the soil surface, under different tillage methods, showed a trend of first decreasing, and then increasing. The results also showed that the RMSHs under rotary tillage, combined tillage, conventional tillage, and reduced tillage in flat land were greater than those in sloping land, and that the CLs of the soil surface under different tillage methods in flat land were smaller than those in sloping land. In addition, the degree of variation in the soil surface roughness was greater in flat land than that in sloping land under all tillage practices, indicating that this study is of great practical importance in the rational selection of tillage methods, and in the scientific quantification of soil erosion, which also show obvious significance for soil and water conservation.