The withdrawal of cultivated land policy is not only an important task to promote cultivated land rest and alleviate the contradiction between supply and demand of water resources in arid areas, but also an important way to realize the sustainable development of agriculture and social economy. This study adopted the minimum per capita area method, ESPR (Exposure-Sensitivity-Pressure-Response) vulnerability assessment model, grey prediction model, and GIS spatial analysis. Furthermore, based on the characteristics of water resource constraints in the arid zone, Manas County was used as the study area. By exploring and analyzing the area of land retreat, through identifying its occurrence and position, the spatial zoning layout of land retreat can be realized to guarantee the effective implementation of water retreat and reduction. The following points were noted from the results: (1) the upper and lower limits of the area of receding land in Manas County were measured using the minimum per capita area method and the principle of balancing water supply and demand. The receding land in Manas County measured 16,493.68–20,749.90 hm2, which accounted for 24.31–30.58% of the total area of cultivated land. (2) The results obtained from constructing the ESPR vulnerability assessment model, used to assess the vulnerability of cultivated land in Manas County, showed that the overall vulnerability of cultivated land in Manas County was high, with 94.74% of the county’s cultivated land being moderately vulnerable or worse, which necessitates the optimization of land use. (3) The area of cultivated land withdrawal under the water resource constraint was used as a constraint for the withdrawal of cultivated land. Based on the evaluation of the vulnerability of cultivated land, with the results arranged from small to large, it was concluded that the area of cultivated land withdrawal in Manas County could reach up to 16,787.34 hm2. There are four types of cultivated land withdrawals: desertified withdrawal, saline withdrawal, groundwater overexploitation withdrawal, and soil contamination withdrawal. The results of this study can provide a reference for Manas County to scientifically formulate a reasonable and orderly withdrawal system of farmland to reduce water use.