We present a framework to design nonlinear robust output feedback model predictive control (MPC) schemes that ensure constraint satisfaction under noisy output measurements and disturbances. We provide novel estimation methods to bound the magnitude of the estimation error based on: stability properties of the observer; detectability; set-membership estimation; moving horizon estimation (MHE). Robust constraint satisfaction is guaranteed by suitably incorporating these online validated bounds on the estimation error in a homothetic tube based MPC formulation. In addition, we show how the performance can be further improved by combining MHE and MPC in a single optimization problem. The framework is applicable to a general class of detectable and (incrementally) stabilizable nonlinear systems. While standard output feedback MPC schemes use offline computed worst-case bounds on the estimation error, the proposed framework utilizes online validated bounds, thus reducing conservatism and improving performance. We demonstrate the reduced conservatism of the proposed framework using a nonlinear 10-state quadrotor example.