This work was aimed to investigate the effects of the different particle size of ground alfalfa hay on caecal microbial and archeal communities of rabbits. One hundred-twenty New Zealand rabbits (950.3 ± 8.82 g) were allocated into four treatments, with five replicates in each treatment and six rabbits in each replicate. The particle sizes of the alfalfa meal in the four treatment diets were 2,500, 1,000, 100 and 10 µm respectively, while the other ingredients were ground through a 2.5 mm sieve. High-throughput sequencing technology was applied to examine the differences in bacteria and methanogenic archaea diversity in the caecum of the four treatment groups of rabbits. A total of 745,946 bacterial sequences (a mean of 31,081 ± 13,901 sequences per sample) and 539,227 archaeal sequences (a mean of 22,468 ± 2,443 sequences per sample) were recovered from twenty-four caecal samples, and were clustered into 9,953 and 2,246 OTUs respectively. A total of 26 bacterial phyla with 465 genera and three archaeal phyla with 10 genera were identified after taxonomic summarization. Bioinformatic analyses illustrated that Firmicutes (58.69% ∼ 68.50%) and Bacteroidetes (23.96% ∼ 36.05%) were the two most predominant bacterial phyla and Euryarchaeota (over 99.9%) was the most predominant archaeal phyla in the caecum of all rabbits. At genus level, as the particle size of alfalfa decreased from 2,500 to 10 µm, the relative abundances of Ruminococcaceae UCG-014 (P < 0.001) and Lactobacillus (P = 0.043) were increased and Ruminococcaceae UCG-005 (P = 0.012) was increased first and then decreased when the alfalfa particle size decreased, while Lachnospiraceae NK4A136 group (P = 0.016), Ruminococcaceae NK4A214 (P = 0.044), Christensenellaceae R-7 group (P = 0.019), Lachnospiraceae other (Family) (P = 0.011) and Ruminococcaceae UCG-013 (P = 0.021) were decreased. The relative abundance of Methanobrevibacter was increased from 62.48% to 90.40% (P < 0.001), whereas the relative abundance of Methanosphaera was reduced from 35.47% to 8.62% (P < 0.001). In conclusion, as the particle size of alfalfa meal decreased, both the bacterial and archaeal population in the caecum of rabbit experienced alterations, however archaea response earlier than bacteria to the decrease of alfalfa meal particle size.