It is well known that CD8+ tumor infiltrating lymphocytes (TIL) are correlated with positive prognoses in cancer patients and used to determine efficacy of immune therapies. While it is generally assumed that CD8+ TIL will be tumor associated antigen (TAA)-specific, it is unknown whether CD8+ T cells with specificity for common pathogens also infiltrate tumors. If so, the presence of these T cells could alter the interpretation of prognostic and diagnostic TIL assays. We compared TAA-specific and virus-specific CD8+ T cells in the same tumors using murine cytomegalovirus (MCMV), a herpesvirus that causes a persistent/latent infection, and Vaccinia virus (VacV), a poxvirus that is cleared by the host. Virus-specific CD8+ TIL migrated into cutaneous melanoma lesions during acute infection with either virus, as well as after a cleared VacV infection, and during a persistent/latent MCMV infection. Virus-specific TILs developed independent of viral antigen in the tumor and interestingly, expressed low or intermediate levels of full-length PD-1 in the tumor environment. Importantly, PD-1 expression could be markedly induced by antigen, but did not correlate with dysfunction for virus-specific TIL, in sharp contrast to TAA-specific TIL in the same tumors. These data suggest that CD8+ TIL can reflect an individual's immune status, rather than exclusively representing TAA-specific T cells, and that PD-1 expression on CD8+ TIL is not always associated with repeated antigen encounter or dysfunction. Thus, functional virus-specific CD8+ TIL could skew the results of prognostic or diagnostic TIL assays.