Insects can navigate efficiently in both novel and familiar environments, and this requires flexiblity in how they are guided by sensory cues. A prominent landmark, for example, can ellicit strong innate behaviours (attraction or menotaxis) but can also be used through learning as a specific directional cue to sustain navigation memory. However, the mechanisms that allow both pathways to co-exist, interact or override each other are largely unknown. Here we propose a model for behavioural integration based on the neuroanatomy of the central complex (CX) and adapted to control landmark guided behaviours. We consider a reward signal provided either by an innate attraction to landmarks or a long-term visual memory that modulates the formation of a local vector memory in the CX. Using an operant strategy for a simulated agent exploring a simple arena world with a single cue, we show how the short-term memory generated can support both innate and learned steering behaviour. In addition, we show how this architecture is consistent with observed effects of unilateral mushroom bodies (MB) lesions in ants that cause a reversion to innate behaviour. We suggest the formation of a directional memory in the CX can be interpreted as transforming rewarding (positive or negative) sensory signals into a geometrical attractiveness (or repulsion) mapping of the environment. We discuss how this scheme might represent an ideal way to combine multisensory information gathered during the exploration of an environment and support optimized cue integration.