The eastern Hengduan Mountains are located in the transition zone between the Qinghai-Tibet Plateau and the Sichuan Basin and are important for global biodiversity and water conservation in China. However, their landscape pattern vulnerability index (LVI) and its influencing factors have not been systematically studied. Therefore, the spatial distribution patterns, LVI, and the landscape artificial disturbance intensity (LHAI) of Ganzi Prefecture were analyzed using ArcGIS software based on landscape data and Digital Elevation Model (DEM) digital elevation data. Then, the LVI response to LHAI and elevation was discussed. The results showed that Ganzi Prefecture was dominated by low- and middle-LVI areas, together accounting for 56.45% of the total area. LVI values were highest in the northern regions, followed by the southern and eastern regions. Batang and Derong counties had the highest LVI values. Most areas in Ganzi Prefecture had very low- or low-LHAI values, accounting for 81.48% of the total area, whereas high-LHAI areas accounted for 2.32% of the total area. Both the LVI and LHAI of Ganzi Prefecture had clustered distributions. Spearman analysis indicated that when elevation exceeded 4500 m, it was the most important factor affecting LVI and LHAI. In the range of 4500–5400 m, the relationship between elevation and LVI shifted from a weak positive correlation to a negative correlation, whereas LHAI was positively correlated with elevation. In addition, LVI also responded significantly to LHAI. However, the relationship kept changing as elevation increased. Hence, the ecological vulnerability of high elevation areas above 4500 m deserves greater attention. In addition, pasture areas in the upstream reaches of the Yalong River in the northern region, the coastal area in the downstream reaches of the Jinsha River in the southern region, and the eastern mining area, should be prioritized for protection and restoration. This research provides a basis for appropriate environmental planning mechanisms and policy protections at the landscape level.