Nonreplication of functional connectivity differences in autism spectrum disorder across multiple sites and denoising strategies

Abstract

A rapidly growing number of studies on autism spectrum disorder (ASD) have used resting‐state fMRI to identify alterations of functional connectivity, with the hope of identifying clinical biomarkers or underlying neural mechanisms. However, results have been largely inconsistent across studies, and there remains a pressing need to determine the primary factors influencing replicability. Here, we used resting‐state fMRI data from the Autism Brain Imaging Data Exchange to investigate two potential factors: denoising strategy and data site (which differ in terms of sample, data acquisition, etc.). We examined the similarity of both group‐averaged functional connectomes and group‐level differences (ASD vs. control) across 33 denoising pipelines and four independently‐acquired datasets. The group‐averaged connectomes were highly consistent across pipelines (r = 0.92 ± 0.06) and sites (r = 0.88 ± 0.02). However, the group differences, while still consistent within site across pipelines (r = 0.76 ± 0.12), were highly inconsistent across sites regardless of choice of denoising strategies (r = 0.07 ± 0.04), suggesting lack of replication may be strongly influenced by site and/or cohort differences. Across‐site similarity remained low even when considering the data at a large‐scale network level or when considering only the most significant edges. We further show through an extensive literature survey that the parameters chosen in the current study (i.e., sample size, age range, preprocessing methods) are quite representative of the published literature. These results highlight the importance of examining replicability in future studies of ASD, and, more generally, call for extra caution when interpreting alterations in functional connectivity across groups of individuals.

Generalizable brain network markers of major depressive disorder across multiple imaging sites

“…Whether a brain network marker constructed in the first stage generalizes to the data acquired from multiple completely different imaging sites is a crucial issue for the above hierarchical supervised/unsupervised approach [20][21][22]. However, an increasing number of studies have highlighted the difficulty in generalization of the brain network marker to the data acquired from multiple completely independent imaging sites, even using the supervised learning method [14,23]. For example, in a recent paper by Drysdale, which is one of the most…”

Brain mapping across 16 autism mouse models reveals a spectrum of functional connectivity subtypes

“…The absence of reliable and specific cross-etiological molecular or genetic biomarkers for ASD 1,39 have prompted research into the use of functional neuroimaging readouts as possible point of convergence for a diagnostic or prognostic characterization of ASD. However, until now connectivity studies in ASD patients have revealed highly heterogeneous and inconsistent results, which has fueled discussion regarding the clinical utility of imaging markers in ASD 40 . Here, we capitalized on recent advances in rodent rsfMRI 19,20,41–44 to measure connectivity across 16 different ASD mouse models.…”

Genes involved in cholesterol cascades are linked to brain connectivity in one third of autistic patients

“…Firstly, our study is based on a large cohort of patients with ASD (N = 880), obtained from the ABIDE initiative, and it combines anatomical and functional neuroimaging data from 24 different institutions. Second, we have used Combat to conduct functional connectivity studies, a highly rigorous method to eliminate the variability between MRI scans across the 24 institutions, one of the largest sources of variability when combining data from multiple institutions (71). Third, our analysis of brain connectivity was carried out on a large-scale, where each brain region is…”