We extend effective field theory to the case of spontaneous symmetry breaking in genuinely finite quantum systems such as small superfluid systems, molecules or atomic nuclei, and focus on deformed nuclei. In finite superfluids, symmetry arguments alone relate the spectra of systems with different particle numbers. For systems with non-spherical intrinsic ground states such as atomic nuclei or molecules, symmetry arguments alone yield the universal features of the low-lying excitations as vibrations that are the heads of rotational bands. The low-lying excitations in deformed nuclei differ from those in molecules because of symmetry properties caused by pairing.