In this work, we present a theoretical scheme to create a reflectionless magnetic-to-optical differential modulator constructed with two mirror symmetrical star structures of three interfaces formed of two gyroelectric materials and a bulk of metal. Taking advantage of two star structures, we receive the modulated signal through coherent superposition of two one-way surface waves. The modulator we have designed can realize the modulation of surface wave in response to magnetic signal. Reflected waves affecting the surrounding devices are prohibited. In addition, the modulator is mini-sized with simple construction and can detect the magnetic signal in an integrated optical system.