MetaCart Sign in to MyCiteSeerX

Include Citations | Advanced Search | Help

Disambiguated Search | Include Citations | Advanced Search | Help

Real-Time 3D Video Compression for Tele-Immersive Environments (2006) [5 citations — 0 self]

by Zhenyu Yang ,  Yi Cui ,  Zahid Anwar ,  Robert Bocchino ,  Nadir Kiyanclar ,  Klara Nahrstedt ,  Roy H. Campbell ,  William Yurcik
in Proceedings of Multimedia Computing and Networking 2006
Add To MetaCart

Abstract:

Tele-immersive systems can improve productivity and aid communication by allowing distributed parties to exchange information via a shared immersive experience. The TEEVE research project at the University of Illinois at Urbana-Champaign and the University of California at Berkeley seeks to foster the development and use of tele-immersive environments by a holistic integration of existing components that capture, transmit, and render three-dimensional (3D) scenes in real time to convey a sense of immersive space. However, the transmission of 3D video poses significant challenges. First, it is bandwidth-intensive, as it requires the transmission of multiple large-volume 3D video streams. Second, existing schemes for 2D color video compression such as MPEG, JPEG, and H.263 cannot be applied directly because the 3D video data contains depth as well as color information. Our goal is to explore from a different angle of the 3D compression space with factors including complexity, compression ratio, quality, and real-time performance. To investigate these trade-offs, we present and evaluate two simple 3D compression schemes. For the first scheme, we use color reduction to compress the color information, which we then compress along with the depth information using zlib. For the second scheme, we use motion JPEG to compress the color information and run-length encoding followed by Huffman coding to compress the depth information. We apply both schemes to 3D videos captured from a real tele-immersive environment. Our experimental results show that: (1) the compressed data preserves enough information to communicate the 3D images effectively (min. PSNR > 40) and (2) even without inter-frame motion estimation, very high compression ratios (avg. > 15) are achievable at speeds suffi...

Citations

524 Plenoptic modeling: An image-based rendering system – McMillan, Bishop - 1995
270 Layered depth images – Shade, Gortler, et al. - 1998
205 Geometric compression through topological surgery – Taubin, Rossignac - 1998
197 Edgebreaker: Connectivity Compression for Triangle Meshes – Rossignac - 1999
90 Constructing virtual worlds using dense stereo – Narayanan, Rander, et al. - 1998
24 3D RGB Image Compression for Interactive Applications – Bajaj, Ihm, et al. - 2001
22 Medical image compression by using three-dimensional wavelet transformation – Wang, Huang - 1996
22 Wavelet-based 3D compression scheme for very large volume data – Ihm, Park - 1998
13 Visualization in Teleimmersive Environments – Leigh, Johnson, et al. - 1999
12 An immersive 3D video-conferencing system using shared virtual team user environments – KAUFF, SCHREER - 2002
10 Real time trinocular stereo for tele-immersion – Mulligan, Daniilidis - 2001
10 3D Compression Made Simple: Edgebreaker with Zip&Wrap on a CornerTable – Rossignac
8 Teeve: The next generation architecture for tele-immersive environments – Yang, Nahrstedt, et al. - 2005
8 Trinocular stereo: A real-time algorithm and its evaluation – Mulligan, Isler, et al. - 2002
8 Retransmission-based error control for interactive video applications over the internet – Rhee - 1998
8 Edgebreaker: A simple compression algorithm for surfaces with handles – LOPES, ROSSIGNAC, et al. - 2003
6 Coordinated multi-streaming for 3D tele-immersion – Ott, Mayer-Patel - 2004
5 Computation and performance issues in coliseum: an immersive videoconferencing system – Baker, Bhatti, et al. - 2003
5 Efficient edgebreaker for surfaces of arbitrary topology – Lewiner, Lopes, et al. - 2004
4 Real-time compression for dynamic 3d environments – Kum, Mayer-Patel, et al. - 2003
3 Real-time multidepth stream compression – Kum, Mayer-Patel - 2005