“…On the other hand, there are also anecdotal reports of positive results, in which researchers have experimentally verified the biological effects of candidate drugs recommended by CMap 1 (Braconi et al, 2009;Brum et al, 2015Brum et al, , 2018Byun et al, 2019;Johnstone et al, 2012;Luo et al, 2019;Schanstra et al, 2019;Wang et al, 2019;Wu et al, 2019) or CMap 2 (Ferguson et al, 2018;Leung et al, 2019;Manzotti et al, 2019;Ryals et al, 2018). An attempt to address the reproducibility question was presented by De Abrew et al, in which they generated an independent CMap-style dataset for 34 compounds in four cell lines (De Abrew et al, 2016). They compared compound retrieval performance to CMap 1 for the 17 compounds shared with their study (their work predates CMap 2).…”