Humans show a gravitational advantage in perception: we are more precise at judging the speed of downwards-moving than upwards-moving objects, indicating that gravitational acceleration is an internalised prior. However, it is unclear whether this gravity prior is based on purely perceptual cues or whether it can incorporate semantic knowledge. Previous research has used only objects which are known to comply with gravity, possibly confounding semantic and perceptual cues. Here we have addressed this question by asking participants to judge the speed of objects that typically move coherently with gravity (ball) or against it (rocket). Our results showed a perceptual advantage for falling stimuli, irrespective of object identity, suggesting the gravity prior is based on perceptual cues.