The optical pump-probe process in terahertz quantum cascade lasers is studied theoretically by using the open system simulation method. The emitter injection is considered and the charge neutrality in the active region is broken. We find that nonequilibrium oscillations may appear in the recovery processes. In particular, the formation of different equilibrium values of the population change after the periodic pulse pumping is observed clearly. Here, the phenomenon of multi-metastable states stems from the electron regulation by the emitter injection. Finally, we discuss the important impacts of the equilibrium stabilization time and obtain an in-depth understanding of the emitter injection.