We propose a novel and generic calibration technique for four-factor foreign-exchange hybrid local-stochastic volatility models (LSV) with stochastic short rates. We build upon the particle method introduced by Guyon and Henry-Labordère [Nonlinear Option Pricing, Chapter 11, Chapman and Hall, 2013] and combine it with new variance reduction techniques in order to accelerate convergence. We use control variates derived from: a calibrated pure local volatility model; a two-factor Heston-type LSV model (both with deterministic rates); the stochastic (CIR) short rates. The method can be applied to a large class of hybrid LSV models and is not restricted to our particular choice of the diffusion. However, we address in the paper some specific difficulties arising from the Heston model, notably by a new PDE formulation and finite element solution to bypass the singularities of the density when zero is attainable by the variance. The calibration procedure is performed on market data for the EUR-USD currency pair and has a comparable run-time to the PDE calibration of a two-factor LSV model alone.