In recent years, Raman spectroscopy has been used to visualize and analyze ferroelectric domain structures. The technique makes use of the fact that the intensity or frequency of certain phonons is strongly influenced by the presence of domain walls. Although the method is used frequently, the underlying mechanism responsible for the changes in the spectra is not fully understood. This inhibits deeper analysis of domain structures based on this method. Two different models have been proposed. However, neither model completely explains all observations. In this work, we have systematically investigated domain walls in different scattering geometries with Raman spectroscopy in the common ferroelectric materials used in integrated optics, i.e., KTiOPO 4 , LiNbO 3 , and LiTaO 3. Based on the two models, we can demonstrate that the observed contrast for domain walls is in fact based on two different effects. We can identify on the one hand microscopic changes at the domain wall, e.g., strain and electric fields, and on the other hand a macroscopic change of selection rules at the domain wall. While the macroscopic relaxation of selection rules can be explained by the directional dispersion of the phonons in agreement with previous propositions, the microscopic changes can be explained qualitatively in terms of a simplified atomistic model.