The Immunoscore is a method to quantify the immune cell infiltration within cancers to predict the disease prognosis. Previous immune profiling approaches relied on limited immune markers to establish patients’ tumor immunity. However, immune cells exhibit a higher-level complexity that is typically not obtained by the conventional immunohistochemistry methods. Herein, we present a spatially variant immune infiltration score, termed as SpatialVizScore, to quantify immune cells infiltration within lung tumor samples using multiplex protein imaging data. Imaging mass cytometry (IMC) was used to target 26 markers in tumors to identify stromal, immune, and cancer cell states within 26 human tissues from lung cancer patients. Unsupervised clustering methods dissected the spatial infiltration of cells in tissue using the high-dimensional analysis of 16 immune markers and other cancer and stroma enriched labels to profile alterations in the tumors’ immune infiltration patterns. Spatially resolved maps of distinct tumors determined the spatial proximity and neighborhoods of immune-cancer cell pairs. These SpatialVizScore maps provided a ranking of patients’ tumors consisting of immune inflamed, immune suppressed, and immune cold states, demonstrating the tumor’s immune continuum assigned to three distinct infiltration score ranges. Several inflammatory and suppressive immune markers were used to establish the cell-based scoring schemes at the single-cell and pixel-level, depicting the cellular spectra in diverse lung tissues. Thus, SpatialVizScore is an emerging quantitative method to deeply study tumor immunology in cancer tissues.