PurposeTo systematically assess the diagnostic performance of the Bosniak classification, version 2019 for risk stratification of cystic renal masses.MethodsWe conducted an electronic literature search on Web of Science, MEDLINE (Ovid and PubMed), Cochrane Library, EMBASE, and Google Scholar to identify relevant articles between June 1, 2019 and March 31, 2022 that used the Bosniak classification, version 2019 for risk stratification of cystic renal masses. Summary estimates of sensitivity, specificity, positive likelihood ratio (LR+), negative likelihood ratio (LR−), and diagnostic odds ratio (DOR) were pooled with the bivariate model and hierarchical summary receiver operating characteristic (HSROC) model. The quality of the included studies was assessed with the Quality Assessment of Diagnostic Accuracy Studies-2 tool.ResultsA total of eight studies comprising 720 patients were included. The pooled sensitivity and specificity were 0.85 (95% CI 0.79–0.90) and 0.68 (95% CI 0.58–0.76), respectively, for the class III/IV threshold, with a calculated area under the HSROC curve of 0.84 (95% CI 0.81–0.87). The pooled LR+, LR−, and DOR were 2.62 (95% CI 2.0–3.44), 0.22 (95% CI 0.16–0.32), and 11.7 (95% CI 6.8–20.0), respectively. The Higgins I2 statistics demonstrated substantial heterogeneity across studies, with an I2 of 57.8% for sensitivity and an I2 of 74.6% for specificity. In subgroup analyses, the pooled sensitivity and specificity for CT were 0.86 and 0.71, respectively, and those for MRI were 0.87 and 0.67, respectively. In five studies providing a head-to-head comparison between the two versions of the Bosniak classification, the 2019 version demonstrated significantly higher specificity (0.62 vs. 0.41, p < 0.001); however, it came at the cost of a significant decrease in sensitivity (0.88 vs. 0.94, p = 0.001).ConclusionsThe Bosniak classification, version 2019 demonstrated moderate sensitivity and specificity, and there was no difference in diagnostic accuracy between CT and MRI. Compared to version 2005, the Bosniak classification, version 2019 has the potential to significantly reduce overtreatment, but at the cost of a substantial decline in sensitivity.