Phenotypic profiling by high throughput microscopy has become one of the leading tools for screening large sets of perturbations in cellular models. Of the numerous methods used over the years, the flexible and economical Cell Painting (CP) assay has been central in the field, allowing for large screening campaigns leading to a vast number of data-rich images. Currently, to analyze data of this scale, available open-source software (i.e., CellProfiler) requires computational resources that are not available to most laboratories worldwide. In addition, the image-embedded cell-to-cell variation of responses within a population, while collected and analyzed, is usually averaged and unused. Here we introduce SPACe (SwiftPhenotypicAnalysis ofCells), an open source, Python-based platform for the analysis of single cell image-based morphological profiles produced by CP experiments. SPACe can process a typical dataset approximately ten times faster than CellProfiler on common desktop computers without loss in mechanism of action (MOA) recognition accuracy. It also computes directional distribution-based distances (Earth Mover’s Distance – EMD) of morphological features for quality control and hit calling. We highlight several advantages of SPACe analysis on CP assays, including reproducibility across multiple biological replicates, easy applicability to multiple (∼20) cell lines, sensitivity to variable cell-to-cell responses, and biological interpretability to explain image-based features. We ultimately illustrate the advantages of SPACe in a screening campaign of cell metabolism small molecule inhibitors which we performed in seven cell lines to highlight the importance of testing perturbations across models.