DMCA
Voice puppetry (1999)
Cached
Download Links
- [www.dgp.toronto.edu]
- [www.cs.cmu.edu]
- [www.cs.cmu.edu]
- DBLP
Other Repositories/Bibliography
| Citations: | 296 - 0 self |
BibTeX
@INPROCEEDINGS{Brand99voicepuppetry,
author = {Matthew Brand},
title = {Voice puppetry},
booktitle = {},
year = {1999},
pages = {21--28}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Frames from a voice-driven animation, computed from a single baby picture and an adult model of facial control. Note the changes in upper facial expression. See figures 5, 6 and 7 for more examples of predicted mouth shapes. We introduce a method for predicting a control signal from another related signal, and apply it to voice puppetry: Generating full facial animation from expressive information in an audio track. The voice puppet learns a facial control model from computer vision of real facial behavior, automatically incorporating vocal and facial dynamics such as co-articulation. Animation is produced by using audio to drive the model, which induces a probability distribution over the manifold of possible facial motions. We present a lineartime closed-form solution for the most probable trajectory over this manifold. The output is a series of facial control parameters, suitable for driving many different kinds of animation ranging from video-realistic image warps to 3D cartoon characters.
Keyphrases
voice puppetry mouth shape probability distribution cartoon character lineartime closed-form solution computer vision expressive information facial control full facial animation many different kind control signal voice puppet video-realistic image warp real facial behavior related signal audio track voice-driven animation facial control parameter probable trajectory adult model possible facial motion single baby picture facial control model upper facial expression facial dynamic
