In order to achieve better performance of fuel consumption in hybrid vehicles, the internal combustion engine is controlled to operate under a better efficient zone and often turned off and on during driving. However, while starting or shifting the driving mode, the instantaneous large torque from the engine or electric motor may occur, which can easily lead to a high vibration of the elastomer on the driveline. This results in decreased comfort. A two-mode power-split hybrid system model with elastomers was established with MATLAB/Simulink. Vibration reduction control strategies, Pause Cancelation strategy (PC), and PID control were developed in this research. When the system detected a large instantaneous torque output on the internal combustion engine or driveline, the electric motor provided corresponding torque to adjust the torque transmitted to the shaft mitigating the vibration. To the research results, in the two-mode power-split hybrid system, PC was able to mitigate the vibration of the engine damper by about 60%. However, the mitigation effect of PID and PC-PID was better than PC, and the vibration was able to converge faster when the instantaneous large torque input was made. In the frequency response, the effect of the PID blocking vibration source came from the elastomer was about 75%, while PC-PID additionally reduced 8% by combining the characteristics of the two control methods.