This study seeks to address the gap in knowledge regarding the varying effects of vegetation on human perception and preference, and to comprehend how green spaces can better serve community needs. The research assessed the impact of different vegetation structures on physiological responses during two types of on-site perceptions: sitting and walking, in both winter and summer. The green spaces included single-layer grassland, single-layer woodland, tree-shrub-grass composite woodlands, and tree-grass composite woodlands, and a non-vegetated square. The findings indicated the following. (1) The physiological recovery effect of walking in green spaces is relatively greater than that of sitting; walking in green spaces with different vegetation types was found to enhance participants’ pNN50 values (p = 0). (2) During the summer, sitting and observing provided a better physiological recovery effect (p < 0.05), whereas in the winter, walking was more beneficial (p < 0.05). (3) Green spaces with vegetation were more beneficial for physiological recovery than the non-vegetated square, which could not sustain recovery effects for more than 1 min. Single-layer grassland and tree-shrub-grass composite woodlands had the most significant physiological recovery effects on health (p < 0.01). (4) Based on these conclusions, it is suggested that a combination of sitting and walking can lead to improved recovery outcomes. Therefore, when visiting parks during extreme weather conditions, individuals should adjust the duration of their sitting and walking experiences to enhance their overall experience.