Leisure agriculture is a crucial carrier for city agriculture and tourism growth. This study aims to explore the overall leisure agriculture and different types of leisure agriculture spatial sub-characteristics and their influencing factors. Taking the city of Xi’an, China, as an example, leisure agriculture was classified into four types: agritainments, agricultural parks, resorts, and rural homestays. According to this study, two ring zones and one core belt zone for leisure agriculture in Xi’an are dispersed unevenly and aggregated. Furthermore, geographic detectors and spatial principal components were employed as empirical techniques to investigate the primary factors influencing the spatial distribution of multiple leisure agriculture heterogeneity. The results about the influence mechanism indicate that the gross domestic product, population density, and accessibility to transportation dominated the overall spatial distribution, while the distance to scenic spots and water areas had a significant impact on the spatial distribution of some types. This research contributes to the reconstruction of leisure agriculture and promotes the sustainable development of agriculture and recreation by merging leisure agriculture spatial resources.