This paper handles locating an autonomous rover whose mission is to explore the unknown outdoor environments, while localizing itself. For localization, the rover occasionally measures the peak of a tall landmark which is known a priori. For the peak measurement, the rover utilizes a monocular camera which is stabilized utilizing a gimbal system. In addition, the rover uses object detection methods to detect a landmark in its camera view. We assume that the height of the landmark is known a priori. Also, we assume that the rover has an altimeter to measure its altitude. Under these assumptions, we present a method to make the rover estimate the relative position of the landmark. Suppose that the rover's target location is set, so that the rover needs to visit the target while avoiding collision with obstacles. Due to environmental disturbance, the rover may not maintain its desired course while it moves. We thus address a guidance control to make the rover approach the target, while compensating the environmental disturbance at the rover's position. As far as we know, this paper is novel in addressing the rover's guidance and localization by measuring the peak of a tall landmark which is known a priori. Furthermore, this paper is novel in utilizing gimbal camera for localization. Thus, we do not require heavy computational load caused by calculating the 6‐DOF transform between the camera and the rover's pose. The effectiveness of the proposed approach is verified utilizing MATLAB simulations.