A simple intuitive physical explanation is offered, of the stability of the inverted pendulum under fast violent vibrations. The direct description allows to analyze, both intuitively and rigorously, the effect of vibrations in similar, and in more general, situations. The rigorous derivations in the paper follow a singular perturbations model of mixed slow and fast dynamics. The approach allows applications beyond the classical inverted pendulum model.