(1) Background: Lower birth weight among newborns in higher altitudes has been well documented in previous literature. Several possible causes for this phenomenon have been investigated, including biophysiological adaptation, epigenetic or genetic mechanisms or lifestyle changes. This is the first study to show the effect modification of altitude and parity on the birth weight length ratio (BWLR) in women resident in moderate altitudes compared to a low sea level.; (2) Methods: This population-based study obtained data on altitude (0–300, 300–500, 500–700,700–900, >900 m), parity (1, 2, …, 7, 8/9), birth weight and length on all births in Austria between 1984 and 2020 from birth certificates provided by Statistics Austria. The BWLR was calculated, and the effect of moderate altitude and parity was estimated using multivariable linear mixed models adjusting for predefined variables. Sub-group regression analyses were conducted by altitude group. (3) Results: Data on 2,057,702 newborns from 1,280,272 mothers were analyzed. The effect of parity on BWLR, as indicated by the difference of BWLR between the first- and second-born infants, ranged between 1.87 to 2.09 g per centimeter across all altitude groups. Our analyses found that the effect of parity on BWLR diminished from parity three onwards at altitude 0–300, whilst the effect of parity on BWLR continued to increase at higher than 300 m and was most notable in the highest altitude group >900 m. (4) Conclusions: Findings from our study indicated that the negative effect of increasing altitude on BWLR was deprived for newborns of higher parity. It shows that the residential altitude can modify the effect of parity on BWLR.