Vitamin D deficiency (VDD) is increasingly prevalent on a global scale and is connected to chronic health issues including diabetes, obesity, and inflammation. This study aimed to investigate the association between VDD and various clinical parameters including glycated hemoglobin (HbA1c), body mass index (BMI), and inflammatory markers. This cross-sectional cohort study included Korean men and women aged 50 years and older (290 men, 125 women); VDD was classified as serum 25-hydroxyvitamin D (25[OH]D) levels below 20 ng/mL. Vitamin D deficiency was more prevalent in men (64.5%) compared to that in women (35.2%). Men with VDD had higher fat mass and HbA1c levels, lower muscle strength, and worse physical performance. Among women, VDD was associated with higher BMI, HbA1c, tumor necrosis factor-alpha (TNF-α), and creatinine levels. In women, 25(OH)D levels exhibited an inverse relationship with HbA1c, BMI, and TNF-α concentrations. However, there were no differences in the levels of interleukin-6 and interleukin-1 beta according to vitamin D status in both men and women. Vitamin D deficiency is linked to higher HbA1c, BMI, and inflammatory markers in older Korean women, thus warranting the maintenance of sufficient vitamin D levels for overall health.