The perceived direction of a moving line changes, often markedly, when viewed through an aperture. Although several explanations of this remarkable effect have been proposed, these accounts typically focus on the percepts elicited by a particular type of aperture and offer no biological rationale. Here, we test the hypothesis that to contend with the inherently ambiguous nature of motion stimuli the perceived direction of objects moving behind apertures of different shapes is determined by a wholly empirical strategy of visual processing. An analysis of moving line stimuli generated by objects projected through apertures shows that the directions of motion subjects report in psychophysical testing is accounted for by the frequency of occurrence of the 2D directions of stimuli generated by simulated 3D sources. The completeness of these predictions supports the conclusion that the direction of perceived motion is fully determined by accumulated behavioral experience with sources whose physical motions cannot be conveyed by image sequences as such.inverse problem ͉ motion ͉ perception ͉ vision ͉ perspective transformation W hen an object moving at a constant speed in a given direction is seen through an occluding aperture the perceived direction of movement is determined by the shape of the aperture and the orientation of the object (typically a rod or line) (see Movies S1-S3). This phenomenon was first studied in detail by Hans Wallach more than 70 years ago using rods that were physically moved behind apertures of various shapes (1). Because of their relevance to understanding the neural basis of motion processing, the puzzling nature of these percepts, collectively referred to as ''aperture effects,'' has attracted much attention ever since (2-8).The approach to rationalizing aperture effects most often cited is based on computations of local image features at the aperture boundaries. In some models, the supposition is that the visual system calculates the local velocity vectors (2, 3, 9-13). However, as generally acknowledged (3), predicting the perceptions elicited by apertures in these terms requires additional assumptions such as constant velocity fields (11-13), object rigidity (14-16), and/or ''smooth'' object motion (3,16). Other computational models have focused on the spatiotemporal energy of local features (17-22) or have used a Bayesian approach (7,8,19) to better tie theory to the observed receptive field properties of visual neurons. Whereas each of these models contends successfully with one aspect or another of the perceptual phenomenology described by Wallach, they deal with a single type of aperture, such as a circle or rectangle. Moreover, none of these existing theories provides a biological explanation for why the perceived directions of motion seen through apertures should differ systematically from the physical direction of motion.An alternative framework for understanding aperture effects, and perhaps the perceived direction of motion generally, is suggested by recent work on the percepti...