We present a robust method of single-photon modulation by directly modulating the single photons and observe its frequency spectrum. Compared with conventional photon counting technique, the single-photon modulation spectrum shows that the method could not only realize high-frequency modulation but also obtain higher signal-to-noise ratio. Moreover, the theoretical calculations show good agreement with the experimental results.