DNA based sequencing technology has revolutionized the field of microbial ecology and environmental studies. However, biases can be introduced at all experimental steps and, thus, affect the interpretation of microbial community. So far, previous studies on the biases introduced from the key steps of DNA extraction and primer sets mainly focused on the bacterial communities in soil or sediment samples, while little is known about the effect on the eukaryotic microbial communities. Here, we studied the effects of three different DNA extraction kits on both prokaryotic and micro-eukaryotic communities by 16S and 18S rRNA gene amplicon sequencing, and further disentangled the influence of primer choice on the micro-eukaryotic communities. Our results showed that the FastDNA SPIN Kit for Soil and DNeasy PowerSoil Kit produced much higher DNA yield with good reproducibility, and observed more eukaryotic OTUs compared to the MinkaGene DNA extraction kit, but all three kits exhibited comparable ability in recovering bacterial alpha diversity. Of the two primer sets, both targeting the V4 region of the 18S rRNA gene, the TAR primer set detected higher number of unique OTUs than the EK primer set, while the EK primer set resulted in longer amplicons and better reproducibility between replicates. Based on our findings, we recommend using the DNeasy PowerSoil Kit with the EK primer set to capture the abundant micro-eukaryotic taxa from freshwater sediment samples. If a more complete picture of the eukaryotic microbial community is desired, the TAR primer set in combination with the FastDNA SPIN Kit is more efficient in this study.