Following the Hamiltonian structure of bi-gravity and multi-gravity models in the full phase space, we have constructed the generating functional of diffeomorphism gauge symmetry. As is expected, this generator is constructed from the first class constraints of the system. We show that this gauge generator works well in giving the gauge transformations of the canonical variables.