The association between the immune status within the tumor microenvironment and prognosis in synovial sarcoma is not well understood. We aimed to investigate the tumor immune microenvironment and analyze its prognostic impact for patients with synovial sarcoma. A total of 36 primary patients who were treated in our institution were retrospectively evaluated. Infiltration of lymphocytes (CD4+, CD8+, and FOXP3+), CD163+ macrophages, and expression of human leukocyte antigen (HLA) class I and programmed death ligand 1 (PD‐L1) were evaluated by immunohistochemistry. Moreover, we investigated PD‐L1 and programmed death ligand 2 (PD‐L2) mRNA expression in 19 of the 36 cases, using real‐time PCR. The Kaplan‐Meier method was used to estimate overall survival and progression‐free survival. Infiltration of lymphocytes and macrophages varied among the patients. Furthermore, the expression of HLA class I was negative or downregulated in 11 specimens. No PD‐L1 expression was observed using immunohistochemistry. Moreover, although PD‐L1 mRNA expression was observed in 18 of 19 specimens, the expression level was low. A higher infiltration of CD8+ or FOXP3+ lymphocytes in patients was associated with a favorable overall survival. In addition, a higher infiltration of CD163+ macrophages indicated a significantly worse overall and progression‐free survival. Infiltration of CD4+ lymphocytes, HLA class I, PD‐L1, and PD‐L2 expression were not associated with patient prognosis. This represents the first report investigating the tumor immune microenvironment as a prognostic factor in synovial sarcoma, indicating that CD163+ macrophages are associated with tumor progression. Our results underscore the clinical significance of the tumor immune microenvironment in synovial sarcoma.