In this study, we aimed to prospectively investigate the relationships between different types of dietary protein and changes in bone mass in Chinese middle-aged and elderly people. Dietary intakes were evaluated by means of a validated food frequency questionnaire. Bone mineral density (BMD) was measured using a dual-energy bone densitometer at multiple bone sites. Multivariable regression models were applied to investigate the associations of the participants’ dietary intakes of total protein, intakes of protein from various sources, and amino acid intakes with the annualized changes in BMD during a 3-year follow-up. A total of 1987 participants aged 60.3 ± 4.9 years were included in the analyses. Multivariable linear regression results showed that dietary intakes of total protein, animal protein, and protein from white meat were positively correlated with BMD changes, with standardized coefficients (β) of 0.104, 0.073, and 0.074 at the femur neck (p < 0.01) and 0.118, 0.067, and 0.067 at the trochanter (p < 0.01), respectively. With each increase of 0.1g·kg−1·d−1 in animal protein and white meat protein intakes, the BMD losses were reduced by 5.40 and 9.24 mg/cm2 at the femur neck (p < 0.05) and 1.11 and 1.84 mg/cm2 at the trochanter (p < 0.01), respectively. Our prospective data, obtained from Chinese adults, showed that dietary total and animal protein, especially protein from white meat, could significantly reduce bone loss at the femur neck and trochanter.