Surgery remains to be the mainstay of treatment for hepatocellular carcinoma (HCC). Nonetheless, its therapeutic efficacy is significantly impaired by postoperative recurrence, which occurs in more than half of cases as a result of intrahepatic metastasis or de novo tumorigenesis. For decades, most therapeutic strategies on inhibiting postoperative HCC recurrence have been focused on the residual tumor cells but satisfying therapeutic outcomes are barely observed in the clinic. In recent years, a better understanding of tumor biology allows us to shift our focus from tumor cells toward the postoperative tumor microenvironment (TME), which is gradually identified to play a pivotal role in tumor recurrence. In this review, we describe various surgical stress and surgical perturbation on postoperative TME. Besides, we discuss how such alternations in TME give rise to postoperative recurrence of HCC. Based on its clinical significance, we additionally highlight the potential of the postoperative TME as a target for postoperative adjuvant therapeutics.