Our study aimed to observe the correlation between epidermal growth factor receptor (EGFR) and programmed cell death-ligand 1 (PD-L1) expression and evaluate prognostic potential of their co-expression in esophageal squamous cell carcinoma (ESCC) patients. EGFR and PD-L1 expression were evaluated by immunohistochemical analysis. We revealed that there was a positive correlation between EGFR and PD-L1 expression in ESCC (P = 0.004). According to the positive relationship between EGFR and PD-L1, all patients were divided into four groups: EGFR (+)/PD-L1 (+), EGFR (+)/PD-L1 (−), EGFR (−)/PD-L1 (+), and EGFR (−)/PD-L1 (−). In 57 ESCC patients without surgery, we found that EGFR and PD-L1 co-expression were statistically correlated with a lower objective response rate (ORR) (p = 0.029), overall survival (OS) (p = 0.018) and progression-free survival (PFS) (p = 0.045) than those with one or none positive protein. Furthermore, PD-L1 expression has a significant positive correlation with infiltration level of 19 immune cells, EGFR expression was significantly correlated with infiltration level of 12 immune cells. The infiltration level of CD8 T cell and B cell were negatively correlated with EGFR expression. On the contrary with EGFR, the infiltration level of CD8 T cell, and B cell were positively correlated with PD-L1 expression. In conclusion, EGFR and PD-L1 co-expression could predict poor ORR and survival in ESCC without surgery, indicating a subset of patients who may benefit from a combination of targeted therapy against EGFR and PD-L1, which may expand the population benefiting from immunotherapy and reduce the occurrence of hyper progressive diseases.