Linear frequency conversion enabled by a temporal boundary of a resonant cavity provides a promising alternative to generating new frequency components, where the temporal boundary can be introduced by rapidly modifying the refractive index of the cavity. However, the perturbed photon dynamics during the ultrafast linear process is still vague. Here, the photon dynamics based on temporal coupled‐mode theory are explored and the phenomena are demonstrated with a silicon metasurface via simulations and experiments in the terahertz regime. With the time‐varying real and imaginary parts of the refractive index, a periodic modulation (Td) of the amplification coefficient of the newly generated photons is observed where the optimized coefficient occurs in the first period at td = Td /2. It further establishes a dynamic critical coupling condition to improve the amplification coefficient in the dynamic process. The scheme of linear frequency conversion via temporal boundary can revolutionize the paradigm of parametric amplification from nonlinear to linear processes, and conversion efficiency will be improved in a high‐quality factor cavity. The ultrafast modulation will find applications in optical signal processing, modulators, and reconfigurable intelligent surfaces for development of the next‐generation communications.