After large-scale exploitation of conventional oil and gas resources, most remaining resources are in highly depleted zones, where the fracture pressure of the formations is greatly reduced. Low-density oil-well cement prevents wellbore and formation fractures by reducing annular liquid column pressure and is one of the most commonly used cements in the oil and gas industry. However, cement sheaths made of low-density oil-well cement can be easily damaged due to the impact load generated during the well completion process. Incorporating carbon fibers into the cement matrix can effectively enhance the performance of cement sheaths. To ensure that carbon fibers can be closely combined with the cement matrix, low-temperature plasma modification technology was used in this study to pretreat the fibers. The mechanical properties of low-density oil-well cement incorporated with unmodified or modified carbon fibers were studied in detail under an impact load. The results of X-ray photoelectron spectroscopy revealed that the content of hydrophilic groups on the surface increased from 18.3 to 60.3% after the plasma treatment. The impact test results showed that the peak strengths of the cements cured at 60 °C for 14 days with 0.3% unmodified and modified carbon fibers could reach 37.01 ± 1.7 and 62.27 ± 1.7 MPa, respectively, under the impact load, i.e., an increase of 68.25% after the carbon fibers were treated with low-temperature plasma. Similarly, the absorbed energy increased from 15.59 to 44.31 J, and the energy absorption rate increased from 25.98 to 73.85%. Low-temperature plasma modification provided hydrophilic functional groups on the surface, significantly improving the interfacial bonding between the carbon fibers and cement matrix. The strengthened interaction was beneficial to extending the bearing time under the impact load and demonstrated a positive influence on the mechanical properties related to the impact resistance.