Phase angle (PhA) is an indicator of cellular health and is positively associated with overall physical activity (PA). However, varied associations between different intensities of PA and PhA by body segment in older populations remain unexplored. We investigated the associations between overall and different intensities of PA and upper-, lower-, and whole-body PhA in older adults. Overall exposure to light-intensity (LPA), moderate-intensity (MPA), and vigorous-intensity physical activity (VPA) was assessed using a triaxial accelerometer (GT3X + , ActiGraph). The outcome variables were upper-, lower-, and whole-body PhA measured using bioelectrical impedance analysis (MC-780MA, TANITA). Multiple linear regression helped examine the associations between the exposure and outcome variables after adjusting for age, gender, body mass index, and accelerometer wear time. A cross-sectional analysis involved 166 community-dwelling older participants (mean age = 72.1 ± 5.5 years; 78.3% women). Overall PA was associated with larger upper- (B: 0.057, 95% confidence interval [CI] 0.018–0.095) and whole-body PhA (B: 0.044, 95% CI 0.006–0.081). LPA was associated with larger upper-body PhA (B: 0.059, 95% CI 0.017–0.101), and MPA was associated with larger lower- (B: 0.273, 95% CI 0.128–0.419) and whole-body PhA (B: 0.141, 95% CI 0.002–0.280). VPA and PhA were not associated. Future interventions targeting PhA in older adults should consider the differential impact of PA intensity on various body segments of the PhA.