To investigate factors associated with time in physical activity intensities, we assessed physical activity of 249 men and women (mean age 51.3 years) by 7-day 24h-accelerometry (ActiGraph GT3X+). Triaxial vector magnitude counts/minute were extracted to determine time in inactivity, in low-intensity, moderate, and vigorous-to-very-vigorous activity. Cross-sectional associations with sex, age, body mass index, waist circumference, smoking, alcohol consumption, education, employment, income, marital status, diabetes, and dyslipidaemia were investigated in multivariable regression analyses. Higher age was associated with more time in low-intensity (mean difference, 7.3 min/d per 5 years; 95% confidence interval 2.0,12.7) and less time in vigorous-to-very-vigorous activity (−0.8 min/d; −1.4, −0.2), while higher BMI was related to less time in low-intensity activity (−3.7 min/d; −6.3, −1.2). Current versus never smoking was associated with more time in low-intensity (29.2 min/d; 7.5, 50.9) and less time in vigorous-to-very-vigorous activity (−3.9 min/d; −6.3, −1.5). Finally, having versus not having a university entrance qualification and being not versus full time employed were associated with more inactivity time (35.9 min/d; 13.0, 58.8, and 66.2 min/d; 34.7, 97.7, respectively) and less time in low-intensity activity (−31.7 min/d; −49.9, −13.4, and −50.7; −76.6, −24.8, respectively). The assessed factors show distinct associations with activity intensities, providing targets for public health measures aiming to increase activity.