In contrast to the well-known phenomenon of frequency stabilization in a synchronized noisy nonlinear oscillator, little is known about its amplitude stability. In this paper, we investigate experimentally and theoretically the amplitude evolution and stability of a nonlinear nanomechanical self-sustained oscillator that is synchronized with an external harmonic drive. We show that the phase difference between the tones plays a critical role on the amplitude level, and we demonstrate that in the strongly nonlinear regime, its amplitude fluctuations are reduced considerably. These findings bring to light a new facet of the synchronization phenomenon, extending its range of applications beyond the field of clock-references and suggesting a new means to enhance oscillator amplitude stability.