Immune cell migration is required for the development of an effective and robust immune response. This elegant process is regulated by both cellular and environmental factors, with variables such as immune cell state, anatomical location, and disease state that govern differences in migration patterns. In all cases, a major factor is the expression of cell surface receptors and their cognate ligands. Rapid adaptation to environmental conditions partly depends on intrinsic cellular immune factors that affect a cell’s ability to adjust to new environment. In this review, we discuss both myeloid and lymphoid cells and outline key determinants that govern immune cell migration, including molecules required for immune cell adhesion, modes of migration, chemotaxis, and specific chemokine signaling. Furthermore, we summarize tumor-specific elements that contribute to immune cell trafficking to cancer, while also exploring microenvironment factors that can alter these cellular dynamics within the tumor in both a pro and antitumor fashion. Specifically, we highlight the importance of the secretome in these later aspects. This review considers a myriad of factors that impact immune cell trajectory in cancer. We aim to highlight the immunotherapeutic targets that can be harnessed to achieve controlled immune trafficking to and within tumors.