“…Automatic segmentation methods are becoming more widespread. Methods such as, but not limited to, (Chekir, Descoteaux, Garyfallidis, Côté, & Boumghar, 2014;Garyfallidis et al, 2017;Guevara et al, 2011;O'Donnell et al, 2017;O'donnell, Golby, & Westin, 2013;Wassermann et al, 2016;Wasserthal, Neher, & Maier-Hein, 2018;Yendiki et al, 2011;Zhang et al, 2018) aim to simplify the work of raters. The typical standard of most automatic segmentation method is to reach the accuracy of raters, thus it is crucial to truly quantify human reproducibility in manual tasks.…”