Track irregularities directly affect the quality and safety of railway vehicle operations. Quantitative detection and real-time monitoring of track irregularities are of great importance. However, due to the frequent variable vehicle speed, vehicle operation is a typical non-stationary process. The traditional signal analysis methods are unsuitable for non-stationary processes, making the quantitative detection of the wavelength and amplitude of track irregularities difficult. To solve the above problems, this paper proposes a quantitative detection method of track irregularities under non-stationary conditions with variable vehicle speed by order tracking analysis for the first time. Firstly, a simplified wheel–rail dynamic model is established to derive the quantitative relationship between the axle-box vertical vibration and the track vertical irregularities. Secondly, the Simpson double integration method is proposed to calculate the axle-box vertical displacement based on the axle-box vertical acceleration, and the process error is optimized. Thirdly, based on the order tracking analysis theory, the angular domain resampling is performed on the axle-box vertical displacement time-domain signal in combination with the wheel rotation speed signals, and the quantitative detection of the track irregularities is achieved. Finally, the proposed method is validated based on simulation and field test analysis cases. We provide theoretical support and method reference for the quantitative detection method of track irregularities.