Reliability of self-reported risk factors for age-related brain disease

Abstract

Importance:modifiable risk factors, including hypertension, hypercholesterolemia, diabetes, kidney disease, hearing impairment, and being overweight, increase risk of stroke, dementia, and late life depression (LLD), but may be poorly understood by patients.Objective:To aid in the design of brain health risk stratification tools, we aimed to determine whether self-reported modifiable risk factors can identify at-risk patients on a population level.Design:cohort study using cross-sectional data of ten iterations of the National Health and Examination Surveys (NHANES) from 1999 to 2018. Analyses were conducted between February and April of 2024.Setting:US population-based cohortsParticipants:all participants who had both questionnaire data and objective measurements available.Exposure:we collected data on answers to common questions and compared these to objectively measured risk factors for age-related brain disease.Main outcomes and measures:we compared answers to simple questions to objectively measured risk factors. We reported means and 95% confidence intervals of objective measurements, created confusion matrices to determine common metrics, and compared performance of individual questions. We defined a question reliable if performance, measured through F1 scores, was > 0.7, as moderately reliable if F1 score was 0.5-0.7 and as unreliable if F1 score was < 0.5.Results:Participants with both objective measurements and questionnaire data ranged from 16,966 (median age 32, 9,113 [20%] black, 19,993 [45%] white) in hearing impairment to 63,834 (median age 39, 14,156 [22%] black, 25,754 [40%] white) in diabetes. Mean values of objective measurements were significantly increased across all risk factors in patients that responded ″Yes″ to common questions on their presence compared to those who answered ″No″. Performance of questions in identifying at-risk patients measured by F1 score was 0.25 in kidney disease, 0.44 in hypercholesterolemia, 0.56 in hypertension, 0.59 in hearing impairment, 0.71 in diabetes and 0.81 in being overweight.Conclusion and relevance:in this study of multiple cohorts of up to 63,834 Americans, self-reported awareness of meeting clinical criteria for diabetes or being overweight were reliable, hypertension or hearing impairment were moderately reliable, and hypercholesterolemia or kidney disease were unreliable. These results could be used to guide construction of risk factor screening tools.