The study investigated the effects of a toughening agent and micron-sized toughening particles (TP) on the resin and carbon fiber-reinforced polymer (CFRP) composites, with a particular focus on compressive strength. The results showed that the addition of the toughening agent improved the overall mechanical properties of both the resin and CFRP but had a minor effect on the residual compressive strength (CAI) of CFRP after impact. Compared to the pure toughening agent, the addition of TP increased the CAI, GIC, and GIIC of CFRP by 74%, 35%, and 68%, respectively. The SEM, ultrasonic C-scan, and metallographic microscopy were used to analyze the failure morphology and TP distribution. Compared to pure toughening agent modification, the introduction of TP led to the formation of continuous toughening particle layers, which reduced the compression damage area by 61%, significantly balancing and absorbing the load. This modification also resulted in typical kink band damage. This study found that resin toughening significantly improved the compressive strength of CFRP, while micron-sized toughening particles, in the form of toughening layers, notably improved the CAI. These findings provide valuable insights for enhancing the compression and impact resistance of CFRP.