Taiwan, an island with three major mountain ranges, provides an ideal topography to study mountain–island effect on organisms that would be diversified in the isolation areas. Glaciations, however, might drive these organisms to lower elevations, causing gene flow among previously isolated populations. Two hypotheses have been proposed to depict the possible refugia for alpine organisms during glaciations. Nunatak hypothesis suggests that alpine species might have stayed in situ in high mountain areas during glaciations. Massif de refuge, on the other hand, proposes that alpine species might have migrated to lower ice‐free areas. By sampling five sympatric carabid species of Nebria and Leistus, and using two mitochondrial genes and two nuclear genes, we evaluated the mountain–island effect on alpine carabids and tested the two proposed hypotheses with comparative phylogeographic method. Results from the phylogenetic relationships, network analysis, lineage calibration, and genetic structure indicate that the deep divergence among populations in all L. smetanai, N. formosana, and N. niitakana was subjected to long‐term isolation, a phenomenon in agreement with the nunatak hypothesis. However, genetic admixture among populations of N. uenoiana and some populations of L. nokoensis complex suggests that gene flow occurred during glaciations, as a massif de refuge depicts. The speciation event in N. niitakana is estimated to have occurred before 1.89 million years ago (Mya), while differentiation among isolated populations in N. niitakana, N. formosana, L. smetanai, and L. nokoensis complex might have taken place during 0.65–1.65 Mya. While each of the alpine carabids arriving in Taiwan during different glaciation events acquired its evolutionary history, all of them had confronted the existing mountain ranges.