This study delves into the factors influencing the willingness of rural land transfers in different terrain areas, aiming to promote the improvement of land transfer institutions and accelerate the process of scale farming. Based on rural survey data from Anhui and Qinghai provinces in China, this research uses geographical detector and Binary Logistic Model to explore the differential factors affecting the willingness of farmers to participate in land contract transfer in the first and third terrain areas of China. The study examines four dimensions, including individual characteristics, family endowments, social support strategies, and geographical environment. The findings reveal the following: (1) By comparing the mean values, standard deviations, and coefficients of variation of the data from both provinces, it is evident that the indicators of individual characteristics, family endowments, social support strategies, and geographical environment differ significantly between the two provinces. This indicates substantial disparities in the basic attributes of farmers and their living environments. (2) The single-factor explanatory power significantly influencing farmers’ willingness to engage in land transfer varies considerably and is statistically significant at the 1% level. The types of interaction between two factors mainly include dual-factor enhancement, nonlinear enhancement, single-factor nonlinear attenuation, and nonlinear attenuation. (3) There are commonalities and differences in the factors that significantly influence farmers’ willingness to participate in land transfer in the two provinces. Common factors influencing farmers’ land transfer willingness in both provinces include: the educational level of household heads, the health status of household heads, the number of family laborers, the arable land area, the differentiation of agricultural management objectives, the proportion of agricultural operating income, labor service economy, and relocation policies. Factors showing different influences include: the age of household heads, school-age children, the number of family members engaged in different occupations, the proportion of income from off-farm employment, minimum guarantee policies credit support, location distance, and terrain undulation. Therefore, in formulating land transfer policies, the government should prioritize significant driving factors influencing farmers’ decision-making behavior in different regions. It is essential to develop and implement land transfer policies tailored to local conditions with the primary goal of safeguarding the rights and interests of the principal stakeholders, thus achieving sustainable land utilization.