DMCA
Noname manuscript No. (will be inserted by the editor) Dynamic Depth of Field on Live Video Streams: A Stereo Solution
BibTeX
@MISC{Yu_nonamemanuscript,
author = {Zhan Yu and Christopher Thorpe and Xuan Yu and Scott Grauer-gray and Feng Li and Jingyi Yu},
title = {Noname manuscript No. (will be inserted by the editor) Dynamic Depth of Field on Live Video Streams: A Stereo Solution},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Abstract The ability to produce dynamic Depth of Field effects in live video streams was until recently a quality unique to movie cameras. In this paper, we present a computational camera solution coupled with real-time GPU processing to produce runtime dynamic Depth of Field effects. We first construct a hybrid-resolution stereo camera with a high-res/low-res camera pair. We recover a low-res disparity map of the scene using GPU-based Belief Propagation and subsequently upsample it via fast Cross/Joint Bilateral Upsampling. With the recovered high-resolution disparity map, we warp the high-resolution video stream to nearby viewpoints to synthesize a light field towards the scene. We exploit parallel processing and atomic operations on the GPU to resolve visibility when multiple pixels warp to the same image location. Finally, we generate dynamic Depth of Field effects from the synthesized light field rendering. All processing stages are mapped onto NVIDIA’s CUDA architecture. Our system can produce Depth of Field effects with arbitrary aperture sizes and focal depths for the resolution of 640×480 at 15 fps.
Keyphrases
dynamic depth field effect live video stream stereo solution synthesized light field fast cross joint bilateral upsampling atomic operation parallel processing high-res low-res camera pair multiple pixel quality unique high-resolution video stream low-res disparity map light field image location hybrid-resolution stereo camera runtime dynamic depth nearby viewpoint focal depth gpu-based belief propagation computational camera solution real-time gpu processing recovered high-resolution disparity map processing stage movie camera arbitrary aperture size cuda architecture
