Colorectal cancer is considered one of the major malignancies that threaten the lives and health of people around the world. Patients with CRC are prone to post-operative local recurrence or metastasis, and some patients are advanced at the time of diagnosis and have no chance for complete surgical resection. These factors make chemotherapy an indispensable and important tool in treating CRC. However, the complex composition of the tumor microenvironment and the interaction of cellular and interstitial components constitute a tumor tissue with high cell density, dense extracellular matrix, and high osmotic pressure, inevitably preventing chemotherapeutic drugs from entering and acting on tumor cells. As a result, a novel drug carrier system with targeted nanoparticles has been applied to tumor therapy. It can change the physicochemical properties of drugs, facilitate the crossing of drug molecules through physiological and pathological tissue barriers, and increase the local concentration of nanomedicines at lesion sites. In addition to improving drug efficacy, targeted nanoparticles also reduce side effects, enabling safer and more effective disease diagnosis and treatment and improving bioavailability. In this review, we discuss the mechanisms by which infiltrating cells and other stromal components of the tumor microenvironment comprise barriers to chemotherapy in colorectal cancer. The research and application of targeted nanoparticles in CRC treatment are also classified.