Complex, goal-directed and time-critical movements require the processing of temporal features in sensory information as well as the fine-tuned temporal interplay of several effectors. Temporal estimates used to produce such behavior may thus be obtained through perceptual or motor processes. To disentangle the two options, we tested whether adaptation to a temporal perturbation in an interval reproduction task transfers to interval reproduction tasks with varying sensory information (visual appearance of targets, modality, and virtual reality [VR] environment or real-world) or varying movement types (continuous arm movements or brief clicking movements). Halfway through the experiments we introduced a temporal perturbation, such that continuous pointing movements were artificially slowed down in VR, causing participants to adapt their behavior to sustain performance. In four experiments, we found that sensorimotor adaptation to temporal perturbations is independent of environment context and movement type, but modality specific. Our findings suggest that motor errors induced by temporal sensorimotor adaptation affect the modality specific perceptual processing of temporal estimates.