Savings refers to the gain in performance upon relearning a task. In sensorimotor adaptation, savings is tested by having participants adapt to perturbed feedback and, following a washout block during which the system resets to baseline, presenting the same perturbation again. While savings has been observed with these tasks, we have shown that the contribution from implicit sensorimotor adaptation, a process that uses sensory prediction errors to recalibrate the sensorimotor map, is actually attenuated upon relearning (Avraham et al., 2021). In the present study, we test the hypothesis that this attenuation is due to interference arising from the washout block, and more generally, from experience with a different relationship between the movement and the feedback. In standard adaptation studies, removing the perturbation at the start of the washout block results in a salient error signal in the opposite direction to that observed during learning. As a starting point, we replicated the finding that implicit adaptation is attenuated following a washout period in which the feedback now signals a salient opposite error. When we eliminated visual feedback during washout, implicit adaptation was no longer attenuated upon relearning, consistent with the interference hypothesis. Next, we eliminated the salient error during washout by gradually decreasing the perturbation, creating a scenario in which the perceived errors fell within the range associated with motor noise. Nonetheless, attenuation was still prominent. Inspired by this observation, we tested participants with an extended experience with veridical feedback during an initial baseline phase and found that this was sufficient to cause robust attenuation of implicit adaptation during the first exposure to the perturbation. This effect was context-specific: It did not generalize to movements that were not associated with the interfering feedback. Taken together, these results show that the implicit sensorimotor adaptation system is highly sensitive to memory interference from a recent experience with a discrepant action-outcome contingency.