In the last decades, our understanding of the role of the immune system in cancer has significantly improved and led to the discovery of new immunotherapeutic targets and tools, which boosted the advances in cancer immunotherapy to fight a growing number of malignancies. Approved immunotherapeutic approaches are currently mainly based on immune checkpoint inhibitors, antibody-derived targeted therapies, or cell-based immunotherapies. In essence, these therapies induce or enhance the infiltration and function of tumor-reactive T cells within the tumors, ideally resulting in complete tumor eradication. While the clinical application of immunotherapies has shown great promise, these therapies are often accompanied either by a variety of side effects as well as partial or complete unresponsiveness of a number of patients. Since different stages of disease progression elicit different local and systemic immune responses, the ability to longitudinally interrogate the migration and expansion of immune cells, especially T cells, throughout the whole body might greatly facilitate disease characterization and understanding. Furthermore, it can serve as a tool to guide development as well as selection of appropriate treatment regiments. This review provides an overview about a variety of immune-imaging tools available to characterize and study T-cell responses induced by anti-cancer immunotherapy. Moreover, challenges are discussed that must be taken into account and overcome to use immune-imaging tools as predictive and surrogate markers to enhance assessment and successful application of immunotherapies.