Understanding the change in vegetation composition along elevational gradients is critical for species conservation in a changing world. We studied the species richness, tree height, and floristic composition of woody plants along an elevation gradient of protected habitats on the eastern slope of Mount Meru and analyzed how these vegetation variables are influenced by the interplay of temperature and precipitation. Vegetation data were collected on 44 plots systematically placed along five transects spanning an elevational gradient of 1600 to 3400 m a.s.l. We used ordinary linear models and multivariate analyses to test the effect of mean annual temperature and precipitation on woody plant species richness, tree height, and floristic composition. We found that species richness, mean tree height, and maximum tree height declined monotonically with elevation. Models that included only mean annual temperature as an explanatory variable were generally best supported to predict changes in species richness and tree height along the elevation gradient. We found significant changes in woody plant floristic composition with elevation, which were shaped by an interaction of mean annual temperature and precipitation. While plant communities consistently changed with temperature along the elevation gradient, levels of precipitation were more important for plant communities at lower than for those at higher elevations. Our study suggests that changes in temperature and precipitation regimes in the course of climate change will reshape elevational gradients of diversity, tree height, and correlated carbon storage in ecosystems, and the sequence of tree communities on East African mountains.