BackgroundOnline data‐collection provide an opportunity for Alzheimer's Disease research to collect large datasets crucial for understanding important public health concerns. However, the reliability of online tasks as compared to those administered in the lab is poorly examined. Our goal is to validate an online version of the short‐term memory‐binding task (STMBT), a potential digital biomarker sensitive to Alzheimer’s Disease (Parra et al., 2010), to understand if data collected online in two environments, at‐home and in the lab, is comparable.MethodWe created an online version of the STMBT task using Psytoolkit (Stoet 2010; Stoet 2017). Development involved piloting, group and user discussions to explore how such a novel tool could be best presented for self‐assessment. Useful insights led to refinement of the online tool (i.e., instruction videos, images, and text). The validation stage involves test‐retest reliability assessment of cognitively fit participants (aged >40 years) who complete the two conditions of this paradigm (i.e., shape only and binding). Task Environment (home and in the lab) and conditions (shape and binding) were fully counterbalanced. Measures of general cognitive abilities, anxiety and at‐home environment were also taken.ResultRecruitment is on‐going, but preliminary data (n=10) has already proved informative. A repeated measures ANOVA looking at task‐accuracy with factors of Environment (home vs. lab) and Condition (shape vs. binding) revealed no significant effects of Environment: F(1, 9) = 0.308, p = .591; Condition: F(1, 9) = 2.202, p = .172); or Interaction: F(1, 9) = 0.308, p = .591). For the shape condition, all participants performed near ceiling regardless of testing environment. In the binding condition, we observed good‐to‐excellent test‐retest reliability between environments using single measures interclass correlation (ICC = 0.954, CI 0.83‐0.99, (F(9, 9) = 39.62, p <.001).ConclusionThese preliminary results indicate the STMBT can provide reliable data when self‐administered using an online version of the task which has important implications for public health researchers. For our fully powered sample, we will provide summary of other measures.
BackgroundOnline data‐collection provide an opportunity for Alzheimer’s Disease research to collect large datasets crucial for understanding important public health concerns. However, the reliability of online tasks as compared to those administered in the lab is poorly examined. Our goal is to validate an online version of the short‐term memory‐binding task (STMBT), a potential digital biomarker sensitive to Alzheimer’s Disease (Parra et al., 2010), to understand if data collected online in two environments, at‐home and in the lab, is comparable.MethodWe created an online version of the STMBT task using Psytoolkit (Stoet 2010; Stoet 2017). Development involved piloting, group and user discussions to explore how such a novel tool could be best presented for self‐assessment. Useful insights led to refinement of the online tool (i.e., instruction videos, images, and text). The validation stage involves test‐retest reliability assessment of cognitively fit participants (aged >40 years) who complete the two conditions of this paradigm (i.e., shape only and binding). Task Environment (home and in the lab) and conditions (shape and binding) were fully counterbalanced. Measures of general cognitive abilities, anxiety and at‐home environment were also taken.ResultRecruitment is on‐going, but preliminary data (n = 10) has already proved informative. A repeated measures ANOVA looking at task‐accuracy with factors of Environment (home vs. lab) and Condition (shape vs. binding) revealed no significant effects of Environment: F(1, 9) = 0.308, p = .591; Condition: F(1, 9) = 2.202, p = .172); or Interaction: F(1, 9) = 0.308, p = .591). For the shape condition, all participants performed near ceiling regardless of testing environment. In the binding condition, we observed good‐to‐excellent test‐retest reliability between environments using single measures interclass correlation (ICC = 0.954, CI 0.83‐0.99, (F(9, 9) = 39.62, p <.001).ConclusionThese preliminary results indicate the STMBT can provide reliable data when self‐administered using an online version of the task which has important implications for public health researchers. For our fully powered sample, we will provide summary of other measures.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2025 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.