In the malignant progression of tumors, there is deposition and cross-linking of collagen, as well as an increase in hyaluronic acid content, which can lead to an increase in extracellular matrix stiffness. Recent research evidence have shown that the extracellular matrix plays an important role in angiogenesis, cell proliferation, migration, immunosuppression, apoptosis, metabolism, and resistance to chemotherapeutic by the alterations toward both secretion and degradation. The clinical importance of tumor-associated macrophage is increasingly recognized, and macrophage polarization plays a central role in a series of tumor immune processes through internal signal cascade, thus regulating tumor progression. Immunotherapy has gradually become a reliable potential treatment strategy for conventional chemotherapy resistance and advanced cancer patients, but the presence of immune exclusion has become a major obstacle to treatment effectiveness, and the reasons for their resistance to these approaches remain uncertain. Currently, there is a lack of exact mechanism on the regulation of extracellular matrix stiffness and tumor-associated macrophage polarization on immune exclusion. An in-depth understanding of the relationship between extracellular matrix stiffness, tumor-associated macrophage polarization, and immune exclusion will help reveal new therapeutic targets and guide the development of clinical treatment methods for advanced cancer patients. This review summarized the different pathways and potential molecular mechanisms of extracellular matrix stiffness and tumor-associated macrophage polarization involved in immune exclusion and provided available strategies to address immune exclusion.