Rapid land use change in the surroundings of protected areas is rampant worldwide. This process is poorly understood and raises questions on how it happens, who shapes it, and the role of administration. To address these questions, we applied a case study in Jinfo National Scenic Area, China, and examined the relationships between land use change, concerned stakeholders, and the administration. Our study revealed that tourism-oriented commercial development and residential relocate were the main reasons for land use change and that the scenic area authorities, tourism enterprises, and locals were pivotal stakeholders in this process. In addition, we identified three authority types since the founding of Jinfo National Scenic Area. Evidence indicates that the conservation-oriented type and development-oriented type were less successful than the integration type in coordinating stakeholders and integrating the scenic area and its surroundings, and the development-oriented type has historically been most closely associated with damaging land use change. Further, we explored the causes for issues during the management of the Jinfo National Scenic Area included frequent administration changes, confusing plans and management goals, absence of a method for involving stakeholders, a lack of clear administrative authority, and a lack of an integrated national legal system. Our study highlights that it is critical to address these problems while aiming for a long-term balance of conservation and sustainable development in scenic areas and their surroundings.