Many cells adjust the direction of polarized growth or migration in response to external directional cues. The yeast Saccharomyces cerevisiae orient their cell fronts (also called polarity sites) up pheromone gradients in the course of mating. However, the initial polarity site is often not oriented towards the eventual mating partner, and cells relocate the polarity site in an indecisive manner before developing a stable orientation. During this reorientation phase, the polarity site displays erratic assembly-disassembly behavior and moves around the cell cortex. The mechanisms underlying this dynamic behavior remain poorly understood. Particle-based simulations of the core polarity circuit revealed that molecular-level fluctuations are insufficient to overcome the strong positive feedback required for polarization and generate relocating polarity sites. Surprisingly, inclusion of a second pathway that promotes polarity site orientation generated a mobile polarity site with properties similar to those observed experimentally. This pathway forms a second positive feedback loop involving the recruitment of receptors to the cell membrane and couples polarity establishment to gradient sensing. This second positive feedback loop also allows cells to stabilize their polarity site once the site is aligned with the pheromone gradient.