Highlights d Cell atlas of multiple developing human endoderm-derived organs d Identified organ-specific epithelial stem cell and mesenchymal cell signatures d Benchmarked intestinal organoid fidelity and maturation using the multi-organ atlas d Interrogated genetic and culture perturbations of epithelium and mesenchyme development

Organoids generated from human pluripotent stem cells (PSCs) provide experimental systems to study development and disease. However, we lack quantitative spatiotemporal descriptions of organoid development that incorporate measurements across different molecular modalities. Here we focus on the retina and use a single-cell multimodal approach to reconstruct human retinal organoid development. We establish an experimental and computational pipeline to generate multiplexed spatial protein maps over a retinal organoid time course and primary adult human retina, registering protein expression features at the population, cellular, and subcellular levels. We develop an analytical toolkit to segment nuclei, identify local and global tissue units, infer morphology trajectories, and analyze cell neighborhoods from multiplexed imaging data. We use this toolkit to visualize progenitor and neuron location, the spatial arrangements of extracellular and subcellular components, and global patterning in each organoid and primary tissue. In addition, we generate a single-cell transcriptome and chromatin accessibility time course dataset and infer a gene regulatory network underlying organoid development. We then integrate genomic data with spatially segmented nuclei into a multi-modal atlas enabling virtual exploration of retinal organoid development. We visualize molecular, cellular, and regulatory dynamics during organoid lamination, and identify regulons associated with neuronal differentiation and maintenance. We use the integrated atlas to explore retinal ganglion cell (RGC) spatial neighborhoods, highlighting pathways involved in RGC cell death. Finally, we show that mosaic CRISPR/Cas genetic perturbations in retinal organoids provide insight into cell fate regulation. Altogether, our work is a major advance toward a virtual human retinal organoid, and provides new directions for how to approach disorders of the visual system. More broadly, our approaches can be adapted to many organoid systems.