Isolation by geographic distance involves in the formation of potential genomic islands and the divergence of genomes, which often result in speciation. The mechanisms of sympatric and allopatric speciation associated with geographic distance remain a topic of interest to evolutionary biologists. Here we examined genomic divergence in three Actinidia species from large-scale sympatric and allopatric regions. Genome sequence data revealed that hexaploid A. deliciosa originated from A. chinensis, and supported the speciation-with-gene-flow model in sympatric regions. The common ancestor of A. setosa and A. deliciosa migrated from the mainland to the Taiwan Island ~2.91 Mya and formed A. setosa ~ 0.92 Mya, and the speciation of A. setosa is consistent with the divergence-after-speciation model with selective sweeps. Geographic isolation resulted in population contraction and accelerated the process of lineage sorting and speciation due to natural selection. Genomic islands contained genes associated with organ development, local adaptation, and stress resistance, indicating selective sweeps on a specific set of traits. Our results highlight the patterns of genomic divergence in sympatric and allopatric speciation, with the mediation of geographic isolation in the formation of genomic islands during Actinidia speciation.