The accuracy of depth judgments that are based on binocular disparity or structure from motion (motion parallax and object rotation) was studied in 3 experiments. In Experiment 1, depth judgments were recorded for computer simulations of cones specified by binocular disparity, motion parallax, or stereokinesis. In Experiment 2, judgments were recorded for real cones in a structured environment, with depth information from binocular disparity, motion parallax, or object rotation about the y-axis. In both of these experiments, judgments from binocular disparity information were quite accurate, but judgments on the basis of geometrically equivalent or more robust motion information reflected poor recovery of quantitative depth information. A 3rd experiment demonstrated stereoscopic depth constancy for distances of 1 to 3 m using real objects in a well-illuminated, structured viewing environment in which monocular depth cues (e.g., shading) were minimized. It has been pointed out that the geometric information supporting the perception of depth from binocular disparity is actually less determinate than that supporting the recovery of structure from object rotation or motion parallax

Accuracy in discriminating rigid from nonrigid motion was investigated for orthographic projections of three-dimensional rotating objects. In 3 experiments the hypothesis that magnitudes of angular velocity are misperceived in the kinetic depth effect was tested, and in 4 other experiments the hypothesis that misperceiving angular velocities leads to misperceiving rigidity was tested. The principal findings were (a) the magnitude of perceived angular velocity is derived heurisdcally as a function of a property of the first-order optic flow called deformation and (b) perceptual performance in discriminating rigid from nonrigid motion is accurate in cases when the variability of the deformations of the individual triplets of points of the stimulus displays favors this interpretation and not accurate in other cases. The human perceptual system is capable of extracting three-dimensional (3-D) information from moving images from which every static pictorial cue to depth has been removed, a phenomenon called the kinetic depth effect (Wallach & O'Cormell, 1953). Numerous attempts to reach a theoretical understanding of this phenomenon have been

Observers viewed monocular animations of rotating dihedral angles and were required to indicate their perceived structures by adjusting the magnitude and orientation of a stereoscopic dihedral angle. The motion displays were created by directly manipulating various aspects of the image velocity field, including the mean translation, the horizontal and vertical velocity gradients, and the manner in which these gradients changed over time. The adjusted orientation of each planar facet was decomposed into components of slant and tilt. Although the tilt component was estimated with a high degree of accuracy, the judgments of slant exhibited large systematic errors. The magnitude of perceived slant was determined primarily by the magnitude of the velocity gradient scaled by its direction. The results also indicate that higher order temporal derivatives of the moving elements had little effect on observers’ judgments. A fundamental issue in the theoretical analysis of threedimensional (3-D) structure from motion concerns the number of distinct views that are required for different types of perceptual judgments. Whereas the first-order relations between pairs of views provide sufficient information

Dynamic random-dot displays representing a rotating cylinder were used to investigate surface interpolation in the perception of structure-from-motion (SFM) in humans. Surface interpolation refers to a process in which a complete surface in depth is reconstructed from the object depth values extracted at the stimulus features. Surface interpolation will assign depth values even in parts of the object that contain no features. Such a "fill-in " process should make the detection of featureless stimulus areas ("holes") difficult. Indeed, we demonstrate that such holes in our rotating cylinder can be as wide as one-quarter of the stimulus before subjects can reliably detect their presence. Subjects were presented with a variation on the rotating cylinder in which all dots were oscillating either in synchrony or asynchronously. Subjects perceive a rigidly rotating cylinder even when such a percept is not in agreement with the physical stimulus. To reconcile this discrepancy between actual and perceived stimulus we propose that individual points contribute to a surface based object representation and that in this process the visual system looses access to the identity of the individual features that make up the surface. Finally we are able to explain a variety of previously documented perceptual peculiarities in the perception of structure-from-motion by arguing that the perceptual interpretation of the object's boundaries influences the surface interpolation process. These findings offer strong perceptual evidence for a process of surface interpolation and are also physiologically plausible given results from recordings in awake behaving monkey cortical areas V1 and MT. The companion paper demonstrates how such a surface interpolation process can be incorporated into a structure-from-motion algorithm and how object boundaries can influence the perception of structure-from-motion as has been demonstrated before and in this paper. Structure-from-motion Surface interpolation Spatial integration Temporal integration Random-dot patterns

Binocular disparity and motion parallax are powerful cues to the relative depth between objects. However to recover absolute depth, either additional scaling parameters are required to calibrate the information provided by each cue, or it can be recovered through the combination of information from both cues (Richards, W. (1985). Structure from stereo and motion. Journal of the Optical Society of America, 2, 343 -- 349). However, not all tasks necessarily require a full specification of the absolute depth structure of a scene and so psychophysical performance may vary depending on the amount of information available, and the degree to which absolute depth structure is required. The experiments reported here used three different tasks that varied in the type of geometric information required in order for them to be completed successfully. These included a depth nulling task, a depth-matching task, and an absolute depth judgement (shape) task. Real world stimuli were viewed (i) monocularly with head movements, (ii) binocularly and static, or (iii) binocularly with head movements. No effect of viewing condition was found whereas there was a large effect of task. Performance was accurate on the matching and nulling tasks and much less accurate on the shape task. The fact that the same perceptual distortions were not evident in all tasks suggests that the visual system can switch strategy according to the demands of the particular task. No evidence was found to suggest that the visual system could exploit the simultaneous presence of disparity and motion parallax. 2000 Elsevier Science Ltd. All rights reserved.

Perceived orientation of axis of rotation and accuracy in discriminating fixed-axis from nordixed-axis rotations were investigated for orthographic projections of three-dimensional rotating objects. The principal findings were (a) the slant of the axis of rotation was systematically misperceived; (b) in both two-view and multiview displays, the perceived slant of the axis of rotation was well-predicted by the ratio between the deformation (a property of the first-order optic flow) and the component parallel to the image plane of the global velocity vector; (c) if this ratio was kept constant in each frame transition of the stimulus sequence (or it was varied), then the stimuli tended to be judged as fixed-axis rotations (or as nonfixed-axis rotations), regardless of whether they simulated a fixed-axis rotation or not; and (d) the tilt of the axis of rotation was perceived in two-view displays with a very small error. A changing two-dimensional (2-D) projection of an object's motion gives rise to a compelling impression of a volumetric shape moving in three-dimensional (3-D) space. This phenomenon (called the kinetic depth effect [KDE] after Wallach & O'Cormell, 1953) represents an essential

Four experiments related human perception of depth–order relations in structure-from-motion displays to current Euclidean and affine theories of depth recovery from motion. Discrimination between parallel and nonparallel lines and relative-depth judgments was observed for orthographic projections of rigidly oscillating random-dot surfaces. We found that (1) depth–order relations were perceived veridically for surfaces with the same slant magnitudes, but were systematically biased for surfaces with different slant magnitudes. (2) Parallel (virtual) lines defined by probe dots on surfaces with different slant magnitudes were judged to be nonparallel. (3) Relative-depth judgments were internally inconsistent for probe dots on surfaces with different slant magnitudes. It is argued that both veridical performance and systematic misperceptions may be accounted for by a heuristic analysis of the first-order optic flow. Appropriate 2-D motions produce phenomenal impressions of movement in depth (see, e.g., Miles, 1931; Musatti, 1924; Wallach & O’Connell, 1953). Certain types of these phenomena have been named structure from motion (SFM). The questions of how these impressions arise and what type of geometric structure is derived from these motions have led to both experimental and theoretical work on depth recovery from motion. The psychophysical research has evaluated the capabilities of the human visual system in light of the constraints and the scope of the algorithms devised to derive 3-D geometric properties from 2-D motions (for a review, see Braunstein,

In three experiments, we investigated the integration of three-dimensional information provided over time by different depth cues. In the first experiment, we found that the perceptual derivation of surface orientation from the optic flow was affected by the prior presentation of static stereo information in the same spatial location. This bias weakened as the length of the motion sequence increased, but it was still present after 800 msec. In the second experiment, conversely, we found that the perceived orientation of a stereo-specified surface was not influenced by the prior presentation of a static stereo surface. In a third experiment, we found that two surfaces defined by identical disparity fields did not elicit the same perceived depth if, previously, one of them had been specified by a conjunction of stereo and motion information. This effect was found to last for at least 400 msec. Taken together, these findings indicate that interactions exist among different sources of depth information, even when they are provided at different moments of time. Human observers obtain information about threedimensional (3-D) shape from a large number of depth cues provided by the visual environment. In recent years, many studies have been carried out to investigate the

We measured thresholds for the monocular discrimination of rigidly and nonrigidly moving objects defined by motion parallax. The retinal projections of rigidly moving objects are subject to certain constraints. By applying smooth 2-D transformations to the projections of rigidly moving objects, we created stimuli in which these constraints were affected. Thresholds for (generic) nonrigid transformations that in theory can be detected from rigid ones by processing pairs of views depended not only on the extent to which the rigidity constraints were affected, but also on the structure and the movement of the simulated object. Nonrigid transformations under which every three successive views had a rigid interpretation were not discriminable from rigid transformations, except in cases where the distortions were very large. Under the rigidity assumption, this would mean that a large class of nonrigidly moving objects is erroneously perceived as rigidly moving. When moving around in the world, we have the impression that the world is stable, rigid, and three-dimensional. This is perhaps remarkable considering the fact that the retinal images change over time. Many experiments show that the visual system is capable of extracting useful information

Many objects have component parts, and these parts often differ in their visual salience. In this paper we present a theory of part salience. The theory builds on the minima rule for defining part boundaries. According to this rule, human vision defines part boundaries at negative minima of curvature on silhouettes, and along negative minima of the principal curvatures on surfaces. We propose that the salience of a part depends on (at least) three factors: its size relative to the whole object, the degree to which it protrudes, and the strength of its boundaries. We present evidence that these factors influence visual processes which determine the choice of figure and ground. We give quantitative definitions for the factors, visual demonstrations of their effects, and results of psychophysical experiments. 1997 Elsevier Science B.V.