Immunotherapeutic drugs including immune checkpoint blockade antibodies have been approved to treat patients in many types of cancers. However, some patients have little or no reaction to the immunotherapy drugs. The mechanisms underlying resistance to tumor immunotherapy are complicated and involve multiple aspects, including tumor-intrinsic factors, formation of immunosuppressive microenvironment, and alteration of tumor and stromal cell metabolism in the tumor microenvironment. T cell is critical and participates in every aspect of antitumor response, and T cell dysfunction is a severe barrier for effective immunotherapy for cancer. Emerging evidence indicates that extracellular vesicles (EVs) secreted by tumor is one of the major factors that can induce T cell dysfunction. Tumor-derived EVs are widely distributed in serum, tissues, and the tumor microenvironment of patients with cancer, which serve as important communication vehicles for cancer cells. In addition, tumor-derived EVs can carry a variety of immune suppressive signals driving T cell dysfunction for tumor immunity. In this review, we explore the potential mechanisms employed by tumor-derived EVs to control T cell development and effector function within the tumor microenvironment. Especially, we focus on current understanding of how tumor-derived EVs molecularly and metabolically reprogram T cell fates and functions for tumor immunity. In addition, we discuss potential translations of targeting tumor-derived EVs to reconstitute suppressive tumor microenvironment or to develop antigen-based vaccines and drug delivery systems for cancer immunotherapy.