A novel time‐varying adaptive controller at the torque level is proposed to simultaneously solve the stabilization and the tracking problem of unicycle mobile robots with unknown dynamic parameters. The idea underlying the controller is intuitively simple: rather than switching between two different types of controllers according to the a priori knowledge of the reference velocities being persistently exciting or not, a new time‐varying signal is introduced to make the single controller capable of adaptively, smoothly, and gradually converting between stabilizer and tracker depending on the instantaneous and past information of the reference velocities. Our control development is based on Lyapunov's direct method and the backstepping technique. Adaptive control techniques are used to deal with parametric uncertainties. The outstanding feature of our controller is computationally simple due to its full use of the existing results on stabilization and tracking control for unicycle robots. With our approach, robots can globally follow a large class of paths including a straight line, a circle, a path approaching a set‐point, or just a set‐point using a single controller. Simulation results for a unicycle‐type mobile robot are provided to illustrate the effectiveness of the proposed controller.