Recognition-induced forgetting is a within-category forgetting effect that results from accessing memory representations. Advantages of this paradigm include the possibility of testing the memory of young children using visual objects before they can read, the testing of multiple types of stimuli, and use with animal models. Yet it is unknown whether just episodic memory tasks (Have you seen this before?) or also semantic memory tasks (Is this bigger than a loaf of bread?) will lead to this forgetting effect. This distinction will be critical in establishing a model of recognition-induced forgetting. Here, we implemented a design in which both these tasks were used in the same experiment to determine which was leading to recognition-induced forgetting. We found that episodic memory tasks, but not semantic memory tasks, created within-category forgetting. These results show that the difference-of-Gaussian forgetting function of recognition-induced forgetting is triggered by episodic memory tasks and is not driven by the same underlying memory signal as semantic memory.