Unique patterns of response to immune checkpoint inhibitor therapy, discernable in the earliest clinical trials, demanded a reconsideration of the standard methods of radiological treatment assessment. Immunomonitoring, that characterizes immune responses, offers several significant advantages over the tumor-centric approach currently used in the clinical practice: 1) better understanding of the drugs’ mechanism of action and treatment resistance, 2) earlier assessment of response to therapy, 3) patient/therapy selection, 4) evaluation of toxicity and 5) more accurate end-point in clinical trials. PET imaging in combination with the right agent offers non-invasive tracking of immune processes on a whole-body level and thus represents a method uniquely well-suited for immunomonitoring. Small molecule metabolic tracers, largely neglected in the immuno-PET discourse, offer a way to monitor immune responses by assessing cellular metabolism known to be intricately linked with immune cell function. In this review, we highlight the use of small molecule metabolic tracers in imaging immune responses, provide a view of their value in the clinic and discuss the importance of image analysis in the context of tracking a moving target.