Persistent Scatterer Interferometry (PSI) data, deriving from the processing of SAR images acquired by highresolution sensors such as TerraSAR-X, provide accurate measurements of displacements affecting structures (e.g., buildings) and linear infrastructure networks (e.g., roads, bridges, embankments, and pipelines). Such widespread displacements, when available on buildings on unstable slopes, offer new perspectives for their integration in procedures pursuing the analysis and the prediction of the physical vulnerability of exposed buildings. In this letter, both deterministic and probabilistic cause (differential settlements)-effects (damage) relationships are generated by using PSI-derived building settlements and the results of building damage surveys. The procedure is applied to El Papiol town (Spain), whose urban area has been suffering diffuse damage of different severity to buildings and roads due to extremely slowmoving landslide phenomena.