Scaling single-cell data exploratory analysis with the rapidly growing diversity and quantity of single-cell omics datasets demands more interpretable and robust data representation that is generalizable across datasets. To address this challenge, here we developed a novel 'quasilinear' framework that combines the interpretability and transferability of linear methods with the representational power of nonlinear methods. Within this framework, we introduce a data representation and visualization method, GraphDR, and a structure discovery method, StructDR, that unifies cluster, trajectory, and surface estimation and allows their confidence set inference. We applied both methods to diverse single-cell RNA-seq datasets from whole embryos and tissues. Unlike PCA and t-SNE, GraphDR and StructDR generated representations that both distinguished highly specific cell types and were comparable across datasets. In addition, GraphDR is at least an order of magnitude faster than commonly used nonlinear methods. Our visualizations of scRNAseq data from developing zebrafish and Xenopus embryos revealed extruding branches of lineages from a continuum of cell states, suggesting that the current branch view of cell specification may be oversimplified. Moreover, StructDR identified a novel neuronal population using scRNA-seq data from mouse hippocampus. An open-source python library and a user-friendly graphical interface for 3D data visualization and analysis with these methods are available at https://github.com/jzthree/quasildr. mature mouse brain cell types 10 (Figure 1a). GraphDR generated representations that preserved the interpretability of subspace like PCA and resolved the different cell types like t-SNE (Figure 1b-d). Therefore, importantly, this gain of interpretability was achieved without a loss of accuracy. Moreover, in a large-scale quantitative benchmark across a diverse set of seven single-cell datasets, GraphDR distinguished cell types/states as well as several current state-of-the-art nonlinear methods, measured by consistency of nearest neighbors in dimensionality-reduced embedding with literature-based cell type identities (Figure 1c-d, Methods).