Diet quality indices can predict nutritional adequacy of usual intake, but validity should be determined. The aim was to assess the validity of total and sub-scale score within the Australian Recommended Food Score (ARFS), in relation to fasting plasma carotenoid concentrations. Diet quality and fasting plasma carotenoid concentrations were assessed in 99 overweight and obese adults (49.5% female, aged 44.6 ± 9.9 years) at baseline and after three months (198 paired observations). Associations were assessed using Spearman’s correlation coefficients and regression analysis, and agreement using weighted kappa (Kw). Small, significantly positive correlations were found between total ARFS and plasma concentrations of total carotenoids (r = 0.17, p < 0.05), β-cryptoxanthin (r = 0.18, p < 0.05), β-carotene (r = 0.20, p < 0.01), and α-carotene (r = 0.19, p < 0.01). Significant agreement between ARFS categories and plasma carotenoid concentrations was found for total carotenoids (Kw 0.12, p = 0.02), β-carotene (Kw 0.14, p < 0.01), and α-carotene (Kw 0.13, p < 0.01). In fully-adjusted regression models the only signification association with ARFS total score was for α-carotene (β = 0.19, p < 0.01), while ARFS meat and fruit sub-scales demonstrated significant relationships with α-carotene, β-carotene, and total carotenoids (p < 0.05). The weak associations highlight the issues with self-reporting dietary intakes in overweight and obese populations. Further research is required to evaluate the use of the ARFS in more diverse populations.