The poor interfacial adhesion between carbon fibers (CFs) and polyimide (PI) resin has seriously hampered the application of CF/PI composites. In this work, the interfacial adhesion was efficiently enhanced by grafting on the CF surface. Surface morphology and surface composition of modified carbon fibers were characterized, which indicated that acrylamide was grafted successfully on the CF surface and the surface roughness was increased slightly. After grafting, the interface shear strength of modified carbon fibers/PI composites was significantly improved by 86.96%, and the interlaminar shear strength was enhanced by 55.61% due to the covalent bonds in interphase and the toughening effect of sizing agent. Moreover, the mechanical properties of composites with different interfacial adhesion were measured, which further confirmed the effect of the grafting modification.