Track irregularity is a type of excitation source for the wheel-rail system, and it is also the major cause of vibration and wheel-rail forces on the axle box bearings of vehicles, and it is commonly found on in-service lines. Therefore, this paper mainly focuses on the dynamic characteristics of high-speed train axle box bearings under track irregularity. Firstly, a nonlinear system containing a faulty double-row tapered roller bearings is established, the obtained equations of motion are solved numerically using the Runge-Kutta and comparing it with the VC vibration frequency and fault characteristic frequency obtained by formula, the comparison results verify the effectiveness of the model. Then, the track irregularity is coupled to the above bearing system, the model is also verified by using the rolling and vibrating test rig of single wheelset. Secondly, the eigenvalue of covariance matrix is introduced as an index to analyze the influence trend of different fault sizes, loads, and inner rotational speeds on the axial trajectory. Finally, the influence trend of track irregularity on the stability of vertical acceleration is analyzed by simulating different operating conditions.