This paper investigates adaptive tracking control in task space for robot manipulators with uncertain system dynamics, input saturation, and time‐varying output constraints simultaneously. An auxiliary system is constructed to compensate the effect of the input saturation, and an asymmetric barrier Lyapunov function (BLF) is applied to tackle time‐varying output constraints, while radial basis function (RBF) neural networks (NN) are used to approximate the unknown closed‐loop dynamics. By introducing a disturbance observer (DO), unknown external disturbances from humans and environment are estimated, and NN approximation errors are compensated. A novel adaptive NN tracking controller is designed to guarantee all signals in the closed‐loop system are semi‐globally uniformly ultimately bounded (UUB), while the tracking errors and observer errors converge to a small neighborhood of zero, and the time‐varying output constraints are not violated. Moreover, the adaptive tracking control of redundant robot manipulators is studied, and the subtask and task space tracking of redundant robot manipulators are realized simultaneously, while the stability of the system is proved by Lyapunov stability theory. Finally, some simulation results are presented to verify the effectiveness and superiority of the proposed control scheme.