There are more than 7,000 languages spoken in the world today 1. It has been argued that the natural and social environment of languages drives this diversity 2-13. However, a fundamental question is how strong are environmental pressures, and does neutral drift suffice as a mechanism to explain diversification? We estimate the phylogenetic signals of geographic dimensions, distance to water, climate and population size on more than 6,000 phylogenetic trees of 46 language families. Phylogenetic signals of environmental factors are generally stronger than expected under the null hypothesis of no relationship with the shape of family trees. Importantly, they are also-in most cases-not compatible with neutral drift models of constant-rate change across the family tree branches. Our results suggest that language diversification is driven by further adaptive and non-adaptive pressures. Language diversity cannot be understood without modelling the pressures that physical, ecological and social factors exert on language users in different environments across the globe. Present-day linguistic diversity is non-randomly distributed across the globe, forming patterns at multiple levels. For example, more than 7,000 languages are currently spoken, and these can be classified into a few hundred language families 1. Each family contains (ideally) all-and only-descendants of a single ancestral protolanguage. Given that languages evolve through time in a manner similar to the evolution of biological species-through splits, extinctions and horizontal exchange-a language family can be approximated by a structured family tree (or phylogeny) that comprises a set of languages spoken by actual human groups occupying geographical space. An intriguing observation is that not only individual languages are non-randomly distributed across the globe; language families are too: some families are huge, spanning vast areas, while others are much more circumscribed. It has been proposed that this patterning reflects ancestral historical events and processes, such as demographic migrations and spreads, or language shift through elite dominance 14. Additionally, there is an emerging view that language diversification cannot be fully understood except in the wider context of physical, cultural and biological variation 15-17. A fundamental question, then, is why and how do language family trees unfold? Is linguistic diversification a self-contained process, or do pressures related to geographic and demographic dimensions drive diversification and shape language family trees? The classic view holds that explanations of diversity have to be sought 'first on the basis of recognized processes of internal change' 18. Here, 'internal' changes are either seen as a 'rather directionless pursuit of individual forms down the branches of the family tree' 19 or as regular phenomena such as sound change and analogy 19. Internal changes are often associated with the term 'linguistic drift' 20 , which