We consider model reduction for linear variational inequalities with parameter-dependent constraints. We study the stability of the reduced problem in the context of a dualized formulation of the constraints using Lagrange multipliers. Our main result is an algorithm that guarantees inf-sup stability of the reduced problem. The algorithm is computationally effective since it can be performed in the offline phase even for parameter-dependent constraints. Moreover, we also propose a modification of the Cone Projected Greedy algorithm so as to avoid ill-conditioning issues when manipulating the reduced dual basis. Our results are illustrated numerically on the frictionless Hertz contact problem between two half-spheres with parameter-dependent radius and on the membrane obstacle problem with parameter-dependent obstacle geometry.