A study of long‐term fMRI reproducibility using data‐driven analysis methods

Abstract

The reproducibility of functional magnetic resonance imaging (fMRI) is important for fMRI-based neuroscience research and clinical applications. Previous studies show considerable variation in amplitude and spatial extent of fMRI activation across repeated sessions on individual subjects even using identical experimental paradigms and imaging conditions. Most existing fMRI reproducibility studies were typically limited by time duration and data analysis techniques. Particularly, the assessment of reproducibility is complicated by a fact that fMRI results may depend on data analysis techniques used in reproducibility studies. In this work, the long-term fMRI reproducibility was investigated with a focus on the data analysis methods. Two spatial smoothing techniques, including a wavelet-domain Bayesian method and the Gaussian smoothing, were evaluated in terms of their effects on the long-term reproducibility. A multivariate support vector machine (SVM)-based method was used to identify active voxels, and compared to a widely used general linear model (GLM)-based method at the group level. The reproducibility study was performed using multisession fMRI data acquired from eight healthy adults over 1.5 years’ period of time. Three regions-of-interest (ROI) related to a motor task were defined based upon which the long-term reproducibility were examined. Experimental results indicate that different spatial smoothing techniques may lead to different reproducibility measures, and the wavelet-based spatial smoothing and SVM-based activation detection is a good combination for reproducibility studies. On the basis of the ROIs and multiple numerical criteria, we observed a moderate to substantial within-subject long-term reproducibility. A reasonable long-term reproducibility was also observed from the inter-subject study. It was found that the short-term reproducibility is usually higher than the long-term reproducibility. Furthermore, the results indicate that brain regions with high contrast-to-noise ratio do not necessarily exhibit high reproducibility. These findings may provide supportive information for optimal design/implementation of fMRI studies and data interpretation.

Variability and Reproducibility of Directed and Undirected Functional MRI Connectomes in the Human Brain

“…In this paper, we have studied the inter- and intra-subject variability of directed and undirected connectivity matrices as well as of global as well as local graph-theoretical metrics derived from resting state functional MRI data in a large sample (n = 1003) of resting state fMRI data, which also has the unique property of including scan-rescan sessions. While previous reproducibility studies exist, they are commonly focused on specific data processing [ 34 ] or statistical [ 35 ] aspects, and are usually based on limited sample sizes.…”