DMCA
SPEECH-DRIVEN MOUTH ANIMATION BASED ON SUPPORT VECTOR REGRESSION
BibTeX
@MISC{Liao_speech-drivenmouth,
author = {Chia-te Liao and Yu-kung Wu and Shang-hong Lai},
title = {SPEECH-DRIVEN MOUTH ANIMATION BASED ON SUPPORT VECTOR REGRESSION},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Visual mouth information has been proved to be very helpful for understanding the speech contents. The synthesis of the corresponding face video directly from the speech signals is strongly demanded since it can significantly reduce the amount of video information for transmission. In this paper, we present a novel statistical learning approach that learns the mappings from input voice signals to the corresponding mouth images. A deformable mouth template model is employed to parameterize the mouth shape corresponding to different transient speech signals followed by a radial basis function (RBF) interpolation technique to synthesize the mouth image according to a new set of predicted mouth shape parameters. The support vector regression (SVR) machine is used to learn the mapping from speech features to visemes, which are parameterized now by a set of mouth shape parameters. From the input speech signals, we can dynamically predict the mouth shapes through the trained SVRs and further synthesize realistic mouth images. Experimental results are shown to demonstrate the vivid speech-driven mouth image synthesis results by using the proposed algorithm.
Keyphrases
trained svr speech feature mouth shape different transient speech signal input voice signal mouth shape parameter novel statistical learning approach interpolation technique support vector regression speech content predicted mouth shape parameter input speech signal corresponding mouth image speech signal deformable mouth template model corresponding face video video information visual mouth information mouth image realistic mouth image new set experimental result radial basis function
