Evidence suggests that irrelevant visual information interferes with the process of generation of visual mental images and, primary visual areas would be essential for visual information maintenance in working memory. Although irrelevant visual information interferes with imagination tasks/generation of visual mental images, this effect is less consistent in visual memory tasks. In this study, we used the retro-cueing paradigm to investigate the retrieval process of information from visual working memory, and the susceptibility of the information retrieved to the effect of an irrelevant visual interference. First, in Experiment 1, we determined the interval between the retro-cue and stimuli-test needed for the information retrieval process. Our results showed that participants had a better performance at intervals above 300 ms. In Experiment 2, we investigated whether the irrelevant visual information would affect the retrieval of representation in visual working memory. In this experiment, the beneficial effect of the retro-cue on performance disappeared in the presence of irrelevant visual information. In experiment 3, we investigated whether the interference effect would be higher at the beginning or end of the retrieval interval. Our results suggest that irrelevant visual information affected performance when it was presented immediately after the retro-cue. These results presuppose the existence of two systems with different characteristics for the information processing in the working memory. The first (similar to a Visual Buffer) would be responsible for the generation and maintenance of visual information in an active state, liable to irrelevant visual information interference. The second (similar to a visual cache) would be a passive short-term visual storage, where the irrelevant visual information would not have access.