In this paper, a new robust controller is proposed to improve the motion control performance of an autonomous four‐wheel steering vehicle. The vehicle is subject to time‐varying uncertainties caused by parameter perturbation and unmodeled disturbance. First of all, the vehicle motion control problem is modeled as a constraint‐following problem with the goal to drive the vehicle system to follow the given constraints. For safety reasons, inequality constraints are imposed on the lateral displacement of the vehicle. Next, the diffeomorphism mapping method is used to deal with the inequality constraints in the vehicle motion control, and the constrained lateral displacement space is mapped to an unbounded space. On this basis, a new multi‐parameter robust constraint‐following control is designed. Based on Lyapunov stability theory, the approximate constraint tracking performance of the path tracking system is proved. In order to make a trade‐off between the system performance and control cost, a multi‐parameter optimization problem is established, and the optimal robust controller is obtained. Last, the main theoretical results are verified by the Carsim‐Simulink co‐simulations.