Neonatal diarrhea in dairy calves causes huge economic and productivity losses in the dairy industry. Zinc is an effective anti-diarrheal agent, but high doses may pose a threat to the environment. Therefore, we aimed to evaluate the effects of low-dose zinc supplementation on the growth, incidence of diarrhea, immune function, and rectal microbiota of newborn Holstein dairy calves. Thirty newborn calves were allocated to either a control group (without extra zinc supplementation), or groups supplemented with either 104 mg of zinc oxide (ZnO, equivalent to 80 mg of zinc/d) or 457 mg of zinc methionine (Zn-Met, equivalent to 80 mg of zinc/d) and studied them for 14 d. The rectal contents were sampled on d 1, 3, 7, and 14, and blood samples were collected at the end of the study. Supplementation with ZnO reduced the incidence of diarrhea during the first 3 d of life, and increased serum IgG and IgM concentrations. The Zn-Met supplementation increased growth performance and reduced the incidence of diarrhea during the first 14 d after birth. The results of fecal microbiota analysis showed that Firmicutes and Proteobacteria were the predominant phyla, and Escherichia and Bacteroides were the dominant genera in the recta of the calves. As the calves grew older, rectal microbial diversity and composition significantly evolved. In addition, dietary supplementation with ZnO reduced the relative abundance of Proteobacteria in 1-d-old calves, and increased that of Bacteroidetes, Lactobacillus, and Faecalibacterium in 7-d-old calves, compared with the control group. Supplementation with Zn-Met increased the relative abundance of the phylum Actinobacteria and the genera Faecalibacterium and Collinsella on d 7, and that of the genus Ruminococcus after 2 wk, compared with the control group. Thus, the rectal microbial composition was not affected by zinc supplementation but significantly evolved during the calves' early life.Zinc supplementation reduced the incidence of diarrhea in young calves. In view of their differing effects, we recommend ZnO supplementation for dairy calves during their first 3 d of life and Zn-Met supplementation for the subsequent period. These findings suggest that zinc supplementation may be an alternative to antibacterial agents for the treatment of newborn calf diarrhea.