Abstract

The CMU RSTA Project has been developing a video-rate stereo machine that has the capability of generating a dense depth map at the video rate. The performance bench marks of the CMU video-rate stereo machine are: 1) multi image input of up to 6 cameras; 2) throughput of 30 million point × disparity range per second; 3) frame rate of 30 frame/ sec; 4) a dense depth map of up to 256 × 240 pixels; 5) disparity search range of up to 60 pixels; 6) high precision of depth output up to 8 bits (with interpolation). The capability of passively producing such a dense depth map (3D representation) of a scene at the video rate can open up a new class of applications of 3D vision: merging real and virtual worlds in real time. 1.

Citations

849	The Laplacian pyramid as a compact image code - Burt, Adelson - 1983
846	A versatile camera calibration technique for highaccuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses - Tsai - 1987
460	What can be seen in three dimensions with an uncalibrated stereo rig - Faugeras - 1992
225	A multiple-baseline stereo - Okutomi, Kanade - 1993
56	Development of a video-rate stereo machine - Kanade, Kato, et al. - 1995
52	Virtualized reality: Concepts and early results - Kanade, Narayanan, et al. - 1995
27	A multiple-baseline stereo method - Okutomi, Kanade, et al. - 1992
19	Adelson E: The Laplacian Pyramid as a Compact Image Code - Burt - 1983
8	Experiments in multiple-baseline stereo - Nakahara, Kanade - 1992
3	Ayache and Francis Lustman, Trinocular stereovision for robotics - Nicholas - 1989
2	Virtualized (Not Virtual) Reality - Kanade, Narayanan, et al. - 1995
2	Z key: a new method for merging real and virtual image - Kanade, Oda, et al. - 1995