Species distributed along mountain slopes, facing contrasting habitats in short geographic scale, are of particular interest to test how ecologically based divergent selection promotes phenotypic and genetic disparities as well as to assess isolation‐by‐environment mechanisms. Here, we conduct the first broad comparative study of phenotypic variation along elevational gradients, integrating a large array of ecological predictors and disentangling population genetic driver processes. The skull form of nine ecologically distinct species distributed over a large altitudinal range (100–4200 m) was compared to assess whether phenotypic divergence is a common phenomenon in small mammals and whether it shows parallel patterns. We also investigated the relative contribution of biotic (competition and predation) and abiotic parameters on phenotypic divergence via mixed models. Finally, we assessed the population genetic structure of a rodent species (Niviventer confucianus) via analysis of molecular variance and FST along three mountain slopes and tested the isolation‐by‐environment hypothesis using Mantel test and redundancy analysis. We found a consistent phenotypic divergence and marked genetic structure along elevational gradients; however, the species showed mixed patterns of size and skull shape trends across mountain zones. Individuals living at lower altitudes differed greatly in both phenotype and genotype from those living at high elevations, while middle‐elevation individuals showed more intermediate forms. The ecological parameters associated with phenotypic divergence along elevation gradients are partly related to species' ecological and evolutionary constraints. Fossorial and solitary animals are mainly affected by climatic factors, while terrestrial and more gregarious species are influenced by biotic and abiotic parameters. A novel finding of our study is that predator richness emerged as an important factor associated with the intraspecific diversification of the mammalian skull along elevational gradients, a previously overlooked parameter. Population genetic structure was mainly driven by environmental heterogeneity along mountain slopes, with no or a week spatial effect, fitting the isolation‐by‐environment scenario. Our study highlights the strong and multifaceted effects of heterogeneous steep habitats and ecologically based divergent selective forces in small mammal populations.