We study single-photon band structure in a one-dimensional (1D) coupled-resonator optical waveguide (CROW) which chirally couples to an array of two-level quantum emitters (QEs). The chiral interaction between the resonator mode and the QE can break the time-reversal symmetry without the magneto-optical effect. As a result, a nonreciprocal single-photon edge state, band gap and flat band appear. By using such a chiral QE-CROW system, including a finite number of unit cells and working in the nonreciprocal band gap, we achieve frequency-multiplex single-photon circulators with high fidelity and low insertion loss. The chiral QE-light interaction can also protect one-way propagation of single photons against backscattering. Our work opens a new door for studying nonreciprocal photonic band structure and exploring its applications in the quantum regime.