We discuss the nature of symmetry breaking and the associated collective excitations for a system of bosons coupled to the electromagnetic field of two optical cavities. For the specific configuration realized in a recent experiment at ETH [1, 2], we show that, in absence of direct intercavity scattering and for parameters chosen such that the atoms couple symmetrically to both cavities, the system possesses an approximate U(1) symmetry which holds asymptotically for vanishing cavity field intensity. It corresponds to the invariance with respect to redistributing the total intensity = + I I I 1 2OPEN ACCESS RECEIVED