DMCA
X.: Face photo-sketch synthesis and recognition (2009)
| Venue: | IEEE Trans. Pattern Anal. Mach. Intell |
| Citations: | 68 - 7 self |
BibTeX
@ARTICLE{Wang09x.:face,
author = {Xiaogang Wang and Xiaoou Tang},
title = {X.: Face photo-sketch synthesis and recognition},
journal = {IEEE Trans. Pattern Anal. Mach. Intell},
year = {2009}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Abstract—In this paper, we propose a novel face photo-sketch synthesis and recognition method using a multiscale Markov Random Fields (MRF) model. Our system has three components: 1) given a face photo, synthesizing a sketch drawing; 2) given a face sketch drawing, synthesizing a photo; and 3) searching for face photos in the database based on a query sketch drawn by an artist. It has useful applications for both digital entertainment and law enforcement. We assume that faces to be studied are in a frontal pose, with normal lighting and neutral expression, and have no occlusions. To synthesize sketch/photo images, the face region is divided into overlapping patches for learning. The size of the patches decides the scale of local face structures to be learned. From a training set which contains photo-sketch pairs, the joint photo-sketch model is learned at multiple scales using a multiscale MRF model. By transforming a face photo to a sketch (or transforming a sketch to a photo), the difference between photos and sketches is significantly reduced, thus allowing effective matching between the two in face sketch recognition. After the photo-sketch transformation, in principle, most of the proposed face photo recognition approaches can be applied to face sketch recognition in a straightforward way. Extensive experiments are conducted on a face sketch database including 606 faces, which can be downloaded from our Web site
Keyphrases
face photo-sketch synthesis face photo sketch recognition law enforcement sketch drawing useful application web site joint photo-sketch model local face structure face sketch recognition normal lighting effective matching digital entertainment neutral expression query sketch drawn multiscale markov random field extensive experiment frontal pose photo-sketch pair recognition method face region multiscale mrf model face sketch database face sketch drawing training set sketch photo image photo-sketch transformation face photo recognition approach straightforward way multiple scale novel face photo-sketch synthesis
