The continued scaling of genetic perturbation technologies combined with high-dimensional assays (microscopy and RNA-sequencing) has enabled genome-scale reverse-genetics experiments that go beyond single-endpoint measurements of growth or lethality. Datasets emerging from these experiments can be combined to construct "maps of biology", in which perturbation readouts are placed in unified, relatable embedding spaces to capture known biological relationships and discover new ones. Construction of maps involves many technical choices in both experimental and computational protocols, motivating the design of benchmark procedures by which to evaluate map quality in a systematic, unbiased manner. In this work, we propose a framework for the steps involved in map building and demonstrate key classes of benchmarks to assess the quality of a map. We describe univariate benchmarks assessing perturbation quality and multivariate benchmarks assessing recovery of known biological relationships from large-scale public data sources. We demonstrate the application and interpretation of these benchmarks through example maps of scRNA-seq and phenomic imaging data.

The combination of modern genetic perturbation techniques with high content screening has enabled genome-scale cell microscopy experiments that can be leveraged to construct maps of biology. These are built by processing microscopy images to produce readouts in unified and relatable representation space to capture known biological relationships and discover new ones. To further enable the scientific community to develop methods and insights from map-scale data, here we release RxRx3, the first ever public high-content screening dataset combining genome-scale CRISPR knockouts with multiple-concentration screening of small molecules (a set of FDA approved and commercially available bioactive compounds). The dataset contains 6-channel fluorescent microscopy images and associated deep learning embeddings from over 2.2 million wells that span 17,063 CRISPR knockouts and 1,674 compounds at 8 doses each. RxRx3 is one of the largest collections of cellular screening data, and as far as we know, the largest generated consistently via a common experimental protocol within a single laboratory. Our goal in releasing RxRx3 is to demonstrate the benefits of generating consistent data, enable the development of the machine learning methods on this scale of data and to foster research, methods development, and collaboration.

CRISPR-Cas9 editing is a scalable technology for mapping of biological pathways, but it has been reported to cause a variety of undesired large-scale structural changes to the genome. We performed an arrayed CRISPR-Cas9 scan of the genome in primary human cells, targeting 17,065 genes for knockout with 101,029 guides. High-dimensional phenomics reveals a "proximity bias" in which CRISPR knockouts bear unexpected phenotypic similarity to knockouts of biologically-unrelated genes on the same chromosome arm, recapitulating both canonical genome structure and structural variants. Transcriptomics connects proximity bias to chromosome-arm truncations. Analysis of published large-scale knockout and knockdown experiments confirms that this effect is general across cell types, labs, Cas9 delivery mechanisms, and assay modalities, and suggests proximity bias is caused by DNA double-strand-breaks with cell cycle control in a mediating role. Finally, we demonstrate a simple correction for large-scale CRISPR screens to mitigate this pervasive bias while preserving biological relationships.