This study aimed to determine the association between demographic factors, body size, and fruit and vegetable intake in the general population, focusing on individuals with both low and high skin carotenoid levels. This cross-sectional study was conducted during the 14th National Convention on the Promotion of Food and Nutrition Education (2019) in Yamanashi, Japan (a rural area) and the Open House 2019 at the National Institute of Biomedical Innovation, Health, and Nutrition in Tokyo, Japan (an urban area). Skin carotenoid measurements were conducted, and the participants were asked to fill out a self-administered questionnaire. The study population consisted of 492 Japanese individuals aged ≥16 years. The odds ratios (ORs) for low skin carotenoid levels were elevated in males, those who were overweight, and those who almost never consumed or consumed only one vegetable dish/day. Conversely, the ORs were lower in those living in Yamanashi, aged 30–39 and ≥70 years, and those who consumed fruit ≥1 time/week. For high skin carotenoid levels, the ORs were higher among those aged ≥70 years, living in Yamanashi, and those who consumed fruit ≥1 time/day or ≥5 vegetable dishes/day. Demographic factors, body size, and habitual fruit and vegetable intake may serve as indicators of skin carotenoid levels.