Moving frames produce large displacements in the perceived location of flashed and continuously moving probes. In a series of experiments, we test the contributions of the probe's displacement and the frame's displacement on the strength of the frame's effect. In the first experiment, we find a dramatic position shift of flashed probes whereas the effect on a continuously moving probe is only one-third as strong. In Experiment 2, we show that the absence of an effect for the static probe is a consequence of its perceptual grouping with the static background. As long as the continuously present probe has some motion, it appears to group to some extent with the frame and show an illusory shift of intermediate magnitude. Finally, we informally explored the illusory shifts seen for a continuously moving probe when the frame itself has a more complex path. In this case, the probe appears to group more strongly with the frame. Overall, the effects of the frame on the probe demonstrate the outcome of a competition between the frame and the static background in determining the frame of reference for the probe's perceived position.