Phlebotomine sandflies are vectors of the humans’ and mammals’ parasite Leishmania spp. Although the role of gut microbiome in the biological cycle of insects is acknowledged, we still know little about the factors modulating the composition of the gut microbiota of sandflies. We tested whether host species impose a strong structural effect on the gut microbiota of Phlebotomus spp. Sandflies were collected from the island of Leros, Greece, and classified to P. papatasi, P. neglectus, P. tobbi, and P. similis, all being negative to Leishmania spp. The prokaryotic gut microbiota was determined via 16S rRNA gene amplicon sequencing. Phlebotomus species supported distinct microbial communities (p < 0.001). P. papatasi microbiota was the most distinct over-dominated by three Spiroplasma, Wolbachia and Paenibacillus operational taxonomic units (OTUs), while another Wolbachia OTU prevailed in P. neglectus. Conversely, the microbiota of P. tobbi and P. similis was composed of several less dominant OTUs. Archaea showed low presence with the dominant OTUs belonging to methanogenic Euryarcheota, ammonia-oxidizing Thaumarcheota, and Nanoarchaeota. We provide first insights into the composition of the bacterial and archaeal community of Phlebotomus sandflies and showed that, in the absence of Leishmania, host genotype is the major modulator of Phlebotomus sandfly gut microbiota.