Purpose The objective of this study was to develop a scalable approach for direct comparison of the analytical sensitivities of commercially available SARS-CoV-2 antigen point-of-care tests (AgPOCTs) to rapidly identify poor-performing products. Methods We present a methodology for quick assessment of the sensitivity of SARS-CoV-2 AgPOCTs suitable for quality evaluation of many different products. We established reference samples with high, medium, and low SARS-CoV-2 viral loads along with a SARS-CoV-2 negative control sample. Test samples were used to semi-quantitatively assess the analytical sensitivities of 32 different commercial AgPOCTs in a head-to-head comparison. Results Among 32 SARS-CoV-2 AgPOCTs tested, we observe sensitivity differences across a broad range of viral loads (9.8 × 108 to 1.8 × 105 SARS-CoV-2 genome copies per ml). 23 AgPOCTs detected the Ct25 test sample (1.6 × 106 copies/ml), while only five tests detected the Ct28 test sample (1.8 × 105 copies/ml). In the low-range of analytical sensitivity, we found three saliva spit tests only delivering positive results for the Ct21 sample (2.7 × 107 copies/ml). Comparison with published data supports our AgPOCT ranking. Importantly, we identified an AgPOCT widely offered, which did not reliably recognize the sample with the highest viral load (Ct16 test sample with 9.8 × 108 copies/ml) leading to serious doubts about its usefulness in SARS-CoV-2 diagnostics. Conclusion The results show that the rapid sensitivity assessment procedure presented here provides useful estimations on the analytical sensitivities of 32 AgPOCTs and identified a widely-spread AgPOCT with concerningly low sensitivity.

Throughout the SARS‐CoV‐2 pandemic, limited diagnostic capacities prevented sentinel testing, demonstrating the need for novel testing infrastructures. Here, we describe the setup of a cost‐effective platform that can be employed in a high‐throughput manner, which allows surveillance testing as an acute pandemic control and preparedness tool, exemplified by SARS‐CoV‐2 diagnostics in an academic environment. The strategy involves self‐sampling based on gargling saline, pseudonymized sample handling, automated RNA extraction, and viral RNA detection using a semiquantitative multiplexed colorimetric reverse transcription loop‐mediated isothermal amplification (RT‐LAMP) assay with an analytical sensitivity comparable with RT‐qPCR. We provide standard operating procedures and an integrated software solution for all workflows, including sample logistics, analysis by colorimetry or sequencing, and communication of results. We evaluated factors affecting the viral load and the stability of gargling samples as well as the diagnostic sensitivity of the RT‐LAMP assay. In parallel, we estimated the economic costs of setting up and running the test station. We performed > 35,000 tests, with an average turnover time of < 6 h from sample arrival to result announcement. Altogether, our work provides a blueprint for fast, sensitive, scalable, cost‐ and labor‐efficient RT‐LAMP diagnostics, which is independent of potentially limiting clinical diagnostics supply chains.

Background: Currently, more than 500 different AgPOCTs for SARS-CoV-2 diagnostics are on sale, for many of which no data about sensitivity other than self-acclaimed values by the manufacturers are available. In many cases these do not reflect real-life diagnostic sensitivities. Therefore, manufacturer-independent quality checks of available AgPOCTs are needed, given the potential implications of false-negative results. Objective: The objective of this study was to develop a scalable approach for direct comparison of the analytical sensitivities of commercially available SARS-CoV-2 antigen point-of-care tests (AgPOCTs) in order to rapidly identify poor performing products. Methods: We present a methodology for quick assessment of the sensitivity of SARS-CoV-2 lateral flow test stripes suitable for quality evaluation of many different products. We established reference samples with high, medium and low SARS-CoV-2 viral loads along with a SARS-CoV-2 negative control sample. Test samples were used to semi-quantitatively assess the analytical sensitivities of 32 different commercial AgPOCTs in a head-to-head comparison. Results: Among 32 SARS-CoV-2 AgPOCTs tested, we observe sensitivity differences across a broad range of viral loads (~7.0*10⁸ to ~1.7*10⁵ SARS-CoV-2 genome copies per ml). 23 AgPOCTs detected the Ct25 test sample (~1.4*10⁶ copies/ ml), while only five tests detected the Ct28 test sample (~1.7*10⁵ copies/ ml). In the low range of analytical sensitivity we found three saliva spit tests only delivering positive results for the Ct21 sample (~2.2*10⁷ copies/ ml). Comparison with published data support our AgPOCT ranking. Importantly, we identified an AgPOCT offered in many local drugstores and supermarkets, which did not reliably recognize the sample with highest viral load (Ct16 test sample with ~7.0*10⁸ copies/ ml) leading to serious doubts in its usefulness in SARS-CoV-2 diagnostics. Conclusion: The rapid sensitivity assessment procedure presented here provides useful estimations on the analytical sensitivities of 32 AgPOCTs and identified a widely-spread AgPOCT with concerningly low sensitivity.

Throughout the current SARS-CoV-2 pandemic, limited diagnostic testing capacity prevented sentinel testing of the population, demonstrating the need for novel testing strategies and infrastructures. Here, we describe the set-up of an alternative testing platform, which allows scalable surveillance testing as an acute pandemic response tool and for pandemic preparedness purposes, exemplified by SARS-CoV-2 diagnostics in an academic environment. The testing strategy involves self-sampling based on gargling saline, pseudonymized sample handling, automated 96-well plate-based RNA extraction, and viral RNA detection using a semi-quantitative multiplexed colorimetric reverse transcription loop-mediated isothermal amplification (RT-LAMP) assay with an analytical sensitivity comparable to RT-quantitative polymerase chain reaction (RT-qPCR). We provide standard operating procedures and an integrated software solution for all workflows, including sample logistics, LAMP assay analysis by colorimetry or by sequencing (LAMP-seq), and communication of results to participants and the health authorities. Using large sample sets including longitudinal sample series we evaluated factors affecting the viral load and the stability of gargling samples as well as the diagnostic sensitivity of the RT-LAMP assay. We performed >35,000 tests during the pandemic, with an average turnover time of fewer than 6 hours from sample arrival at the test station to result announcement. Altogether, our work provides a blueprint for fast, sensitive, scalable, cost- and labor-efficient RT-LAMP diagnostics. As RT-LAMP-based testing requires advanced, but non-specialized laboratory equipment, it is independent of potentially limiting clinical diagnostics supply chains.