We present the experimental phase diagram of LiHo x Er 1-x F 4 , a dilution series of dipolar-coupled model magnets. The phase diagram was determined using a combination of ac susceptibility and neutron scattering. Three unique phases in addition to the Ising ferromagnet LiHoF 4 and the XY antiferromagnet LiErF 4 have been identified. Below x = 0.86, an embedded spin-glass phase is observed, where a spin glass exists within the ferromagnetic structure. Below x = 0.57, an Ising spin glass is observed consisting of frozen needlelike clusters. For x ∼ 0.3-0.1, an antiferromagnetically coupled spin glass occurs. A reduction of T C (x) for the ferromagnet is observed which disobeys the mean-field predictions that worked for LiHo x Y 1-x F 4 .