Inappropriate soil management accelerates soil erosion and thus poses a serious threat to food security and biodiversity. Due to poor data availability and fragmented terrain, the landscape pattern of garden erosion in tropical Xishuangbanna is not clear. In this study, by integrating multi-source satellite imagery, field investigation and visual interpretation, we realized high-resolution mapping of gardens and soil conservation measures at the landscape scale. The Chinese Soil Loss Equation (CSLE) model was then performed to estimate the garden erosion rates and to identify critical erosion-prone areas; the landscape pattern of soil erosion was further discussed. Results showed the following: (1) For the three major plantations, teas have the largest degree of fragmentation and orchards suffer the highest soil erosion rate, while rubbers show the largest patch area, aggregation degree and soil erosion ratio. (2) The average garden erosion rate is 1595.08 t·km−2a−1, resulting in an annual soil loss of 9.73 × 106 t. Soil erosion is more susceptible to elevation and vegetation cover rather than the slope gradient. Meanwhile, irreversible erosion rates only occur in gardens with fraction vegetation coverage (FVC) lower than 30%, and they contribute 68.19% of total soil loss with the smallest land portion, indicating that new plantations are suffering serious erosion problems. (3) Garden patches with high erosion intensity grades and aggregation indexes should be recognized as priorities for centralized treatment. For elevations near 1900 m and lowlands (<950 m), the decrease in the fractal dimension index of erosion-prone areas indicates that patches are more regular and aggregated, suggesting a more optimistic conservation situation.