In this study, our aim was to investigate the potential correlation between the mother’s total gestational weight gain (GWG) rate and the trimester-specific GWG rate (GWGR) with the physical development status of the child within 24 months of age. We utilized linear regression models and linear mixed effects models to explore both time point and longitudinal relationships between GWGR and children’s anthropometric outcome z-scores at 0, 1, 2, 4, 6, 9, 12, 18, and 24 months. To examine the critical exposure windows, we employed multiple informant models. We also conducted a stratified analysis considering pre-pregnancy BMI and the gender of the children. Our findings revealed notable positive associations between total GWGR and z-scores for body mass index for age (BMIZ), head circumference for age (HCZ), weight for age (WAZ), length for age (LAZ), and weight for length (WHZ) across different trimesters of pregnancy (pint < 0.05). The GWGR during the first two trimesters mainly influenced the relationship between total GWGR and BMIZ, WAZ, and LAZ, while the GWGR during the first trimester had a significant impact on the correlation with HCZ (0.206, 95% CI 0.090 to 0.322). Notably, the associations of GWGR and children’s BMIZ were pronounced in male children and pre-pregnancy normal-weight women. In conclusion, our study findings indicated that a higher GWGR during each trimester was associated with greater physical growth during the first 24 months of life, especially GWGR in the first and second trimesters.