In two experiments, we evaluated the ability of human observers to make use of second-order temporal relations across three or more views of an apparent motion sequence for the perceptual analysis of three-dimensional form. Ratings of perceived rigidity were obtained in Experiment 1 for objects rotating in depth that were simultaneously subjected to sinusoidal affine stretching transformations along the line of sight or in a direction parallel to the image plane. Such transformations are theoretically interesting because they cannot be detected by analyses that are restricted to first-order temporal relations (i.e., two views), but they can be detected by more conventional analyses of structure from motion in which second-order temporal relations over three or more views are used. The current results show that human observers can perceive stretching transformations of a rotating 3-D object in a direction parallel to the image plane but that they fail to perceive stretching transformations along the line of sight. This result suggests that human observers can make use of some limited second-order temporal information. This finding was confirmed in Experiment 2, in which we investigated the effects of several specific optical consequences of sinusoidal stretching transformations applied in different directions. The results indicate that observers may be sensitive to the sign of acceleration, but that they cannot make use of the precise magnitude of second-order relations necessary to recover euclidean metric structure.Human observers have the remarkable ability to perceive an object's three-dimensional (3-D) form from its projected pattern of motion within a 2-D visual image. This phenomenon, sometimes referred to as the kinetic depth effect, has been widely investigated by perceptual psychologists for over 60 years (Braunstein, 1962; J. J.Gibson & E. J. Gibson, 1957; E. J. Gibson, J. J. Gibson, Smith, & Flock, 1959; Green, 1961;Johansson, 1964;Johansson & Jansson, 1968;Metzger, 1934;Miles, 1931;Wallach & O'Connell, 1953). More recently, this capability has also attracted the attention of researchers in machine vision, who have developed working algorithms for computing an object's 3-D structure from moving 2-D optical patterns.Most mathematical analyses for computing structure from motion are designed to operate on a small number of identifiable points across a small number of discrete temporal "views." The goal of these analyses is to discover whether there is a rigid (usually) 3-D structure compatible with the positions of those points over time. Ullman (1979) has shown that one can recover 3-D structure from orthographic projections given the motions of