Volcanic eruptions can have a significant influence on adjacent ecosystems; however, little is known about the long-term vegetation change related to eruptions. In this study, we examined phytolith records in paleosols at multiple sites in the southern Kyushu District, Japan, to assess the influence of the Kikai caldera eruption 7300 years ago on vegetation. Our results show the vegetational difference before and after the eruption in the study region. Specifically, in the area where the pyroclastic flows distributed more thickly, the original evergreen forest was replaced by Andropogoneae grasslands after the eruption, which has been dominating the landscape in this area for at least 900 years. By contrast, in areas only mildly affected by pyroclastic flows, despite the temporary replacement of forest by grassland, the forest developed and flourished within several hundreds of years of the eruption. This is because a large amount of pyroclastic flow would have devastated all of the vegetation, whereas smaller amounts would have left some untouched forest sites within refugia. Our findings suggest that the vegetation varied significantly depending on the amount of pyroclastic flow reaching the area, even within the pyroclastic flow distributed region.