DMCA
Markerless Motion Capture of Multiple Characters Using Multi-view Image Segmentation
Cached
Download Links
| Citations: | 4 - 2 self |
BibTeX
@MISC{Liu_markerlessmotion,
author = {Yebin Liu and Juergen Gall Member and Carsten Stoll and Qionghai Dai and Senior Member and Hans-peter Seidel and Christian Theobalt},
title = {Markerless Motion Capture of Multiple Characters Using Multi-view Image Segmentation},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Abstract—Capturing the skeleton motion and detailed time-varying surface geometry of multiple, closely interacting persons is a very challenging task, even in a multi-camera setup, due to frequent occlusions and ambiguities in feature-to-person assignments. In order to address this task, we propose a framework that exploits multi-view image segmentation. To this end, a probabilistic shape and appearance model is employed to segment the input images and to assign each pixel uniquely to one person. Given the articulated template models of each person and the labeled pixels, a combined optimization scheme, which splits the skeleton pose optimization problem into a local one and a lower dimensional global one, is applied one-by-one to each individual, followed with surface estimation to capture detailed non-rigid deformations. We show on various sequences that our approach can capture the 3D motion of humans accurately even if they move rapidly, if they wear wide apparel, and if they are engaged in challenging multi-person motions, including dancing, wrestling, and hugging. Index Terms—Markerless motion capture, multi-view video, multiple characters, image segmentation. 1
Keyphrases
markerless motion capture image segmentation frequent occlusion multi-person motion interacting person labeled pixel probabilistic shape index term markerless motion capture surface estimation multi-view video various sequence detailed time-varying surface geometry dimensional global one detailed non-rigid deformation multiple character appearance model input image optimization problem multi-view image segmentation wide apparel combined optimization scheme multi-camera setup articulated template model challenging task skeleton motion feature-to-person assignment
