Lipreading by locality discriminant graph

DMCA

Lipreading by locality discriminant graph (2007)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Yun Fu , Xi Zhou , Ming Liu , Mark Hasegawa-johnson , Thomas S. Huang

Venue:	in Proc. ICIP
Citations:	7 - 0 self

BibTeX

@INPROCEEDINGS{Fu07lipreadingby,
    author = {Yun Fu and Xi Zhou and Ming Liu and Mark Hasegawa-johnson and Thomas S. Huang},
    title = {Lipreading by locality discriminant graph},
    booktitle = {in Proc. ICIP},
    year = {2007}
}

OpenURL

Abstract

The major problem in building a good lipreading system is to extract effective visual features from enormous quantity of video sequences data. For appearance-based feature analysis in lipreading, classical methods, e.g. DCT, PCA and LDA, are usually applied to dimensionality reduction. We present a new pattern classification algorithm, called Locality Discriminant Graph (LDG), and develop a novel lipreading framework to successfully apply LDG to the problem. LDG takes both advantage of manifold learning and Fisher criteria to seek the linear embedding which preserves the local neighborhood affinity within same class while discriminating the neighborhood among different classes. The LDG embedding is computed in closed-form and tuned by the only open parameter of k-NN number. Experiments on AVICAR corpus database provide evidence that the graph-based pattern classification methods can outperform classical ones for lipreading. Index Terms — Lipreading, graph embedding, discriminant analysis, audio-visual speech, discrete cosine transform.

Keyphrases

locality discriminant graph graph-based pattern classification method manifold learning ldg embedding video sequence data k-nn number good lipreading system audio-visual speech discrete cosine transform major problem linear embedding discriminant analysis local neighborhood affinity enormous quantity avicar corpus database novel lipreading framework classical one appearance-based feature analysis new pattern classification algorithm different class effective visual feature index term lipreading open parameter classical method graph embedding fisher criterion

DMCA