MRIQC: Advancing the Automatic Prediction of Image Quality in MRI from Unseen Sites

Abstract

Quality control of MRI is essential for excluding problematic acquisitions and avoiding bias in subsequent image processing and analysis. Visual inspection is subjective and impractical for large scale datasets. Although automated quality assessments have been demonstrated on single-site datasets, it is unclear that solutions can generalize to unseen data acquired at new sites. Here, we introduce the MRI Quality Control tool (MRIQC ), a tool for extracting quality measures and fitting a binary (accept/exclude) classifier. Our tool can be run both locally and as a free online service via the OpenNeuro.org portal. The classifier is trained on a publicly available, multi-site dataset (17 sites, N=1102). We perform model selection evaluating different normalization and feature exclusion approaches aimed at maximizing across-site generalization and estimate an accuracy of 76%±13% on new sites, using leave-one-site-out cross-validation. We confirm that result on a held-out dataset (2 sites, N=265) also obtaining a 76% accuracy. Even though the performance of the trained classifier is statistically above chance, we show that it is susceptible to site effects and unable to account for artifacts specific to new sites. MRIQC performs with high accuracy in intra-site prediction, but performance on unseen sites leaves space for improvement which might require more labeled data and new approaches to the between-site variability. Overcoming these limitations is crucial for a more objective quality assessment of neuroimaging data, and to enable the analysis of extremely large and multi-site samples.

Cognitive and brain development is independently influenced by socioeconomic status and polygenic scores for educational attainment

“…From 1963 subjects, 1168 had structural scans at both timepoints, from these 748 passed quality control (pass rate 64%). In a similar fashion to previous research with large sample sizes quality control was not entirely overlapping between the two raters 55 . In the overlap sample of 101 subjects we found a high inter-rater agreement (kappa = 0.88).…”

Acute social isolation evokes midbrain craving responses similar to hunger

“…Spatial smoothing was performed on the FMRIPrep outputs with a 6mm smoothing kernel using FSL's SUSAN tool (76), which uses segmentation boundaries to avoid smoothing across tissue types. MRIQC, an opensource quality assurance software tool (77), was used to generate additional reports which display Image Quality Metrics (IQMs).…”

Cortico-hippocampal network connections support the multidimensional quality of episodic memory

“…Physiological data, including heart rate and respiration, were also collected but were not further analyzed. (Esteban et al, 2017) was used as a preliminary check of MRI data quality. Scan runs were excluded from data analyses if more than 20% of TRs exceeded a framewise displacement of 0.3 mm.…”