<p>Owing to highly conductive solid ionic conductors, all-solid-state batteries attract significant attention as promising next-generation energy storage devices. A lot of research is invested in the search and optimization of solid electrolytes with higher ionic conductivity. However, a systematic study of an <i>interlaboratory reproducibility</i> of measured ionic conductivities and activation energies is missing, making the comparison of absolute values in literature challenging. In this study, we perform an uncertainty evaluation via a Round Robin approach using different Li-argyrodites exhibiting orders of magnitude different ionic conductivities as reference materials. Identical samples are distributed to different research laboratories and the conductivities and activation barriers are measured by impedance spectroscopy. The results show large ranges of up to 4.5 mScm<sup>-1</sup> in the measured total ionic conductivity (1.3 – 5.8 mScm<sup>-1</sup> for the highest conducting sample, relative standard deviation 35 – 50% across all samples) and up to 128 meV for the activation barriers (198 – 326 meV, relative standard deviation 5 – 15%, across all samples), presenting the necessity of a more rigorous methodology including further collaborations within the community and multiplicate measurements.</p>