Diverse drivers such as climate, soil fertility, neighborhood competition, and functional traits all contribute to variation in tree stem demographic rates. However, these demographic drivers operate at different scales, making it difficult to compare the relative importance of each driver on tree demography. Using c. 20,000 stem records from New Zealand's temperate rain forests, we analyzed the growth, recruitment, and mortality rates of 48 tree species and determined the relative importance of demographic drivers in a multilevel modeling approach. Tree species' maximum height emerged as the one most strongly associated with all demographic rates, with a positive association with growth rate and negative associations with recruitment and mortality rates. Climate, soil properties, neighborhood competition, stem size, and other functional traits also played significant roles in shaping demographic rates. Forest structure and functional composition were linked to climate and soil, with warm, dry climates and fertile soil associated with higher growth and recruitment rates. Neighborhood competition affected demographic rates depending on stem size, with smaller stems experiencing stronger negative effects, suggesting asymmetric competition where larger trees exert greater competitive effects on smaller trees. Our study emphasizes the importance of considering multiple drivers of demographic rates to better understand forest tree dynamics.