DMCA
Matching composite sketches to face photos: A component-based approach
| Venue: | IEEE Trans. IFS |
| Citations: | 12 - 7 self |
BibTeX
@ARTICLE{Han_matchingcomposite,
author = {Hu Han and Brendan Klare and Kathryn Bonnen and Anil K. Jain},
title = {Matching composite sketches to face photos: A component-based approach},
journal = {IEEE Trans. IFS},
year = {},
pages = {2013}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Abstract — The problem of automatically matching composite sketches to facial photographs is addressed in this paper. Previous research on sketch recognition focused on matching sketches drawn by professional artists who either looked directly at the subjects (viewed sketches) or used a verbal description of the subject’s appearance as provided by an eyewitness (forensic sketches). Unlike sketches hand drawn by artists, composite sketches are synthesized using one of the several facial composite software systems available to law enforcement agencies. We propose a component based representation (CBR) approach to measure the similarity between a composite sketch and mugshot photograph. Specifically, we first automatically detect facial landmarks in composite sketches and face photos using an active shape model (ASM). Features are then extracted for each facial component using multiscale local binary patterns (MLBP), and per component similarity is calculated. Finally, the similarity scores obtained from individual facial components are fused together, yielding a similarity score between a composite sketch and a face photo. Matching performance is further improved by filtering the large gallery of mugshot images using gender information. Experimental results on matching 123 composite sketches against two galleries with 10,123 and 1,316 mugshots show that the proposed method achieves promising performance (rank-100 accuracies of 77.2 % and 89.4%, respectively) compared to a leading commercial face recognition system (rank-100 accuracies of 22.8 % and 52.0%) and densely sampled MLBP on holistic faces (rank-100 accuracies of 27.6 % and 10.6%). We believe our prototype system will be of great value to law enforcement agencies in apprehending suspects in a timely fashion. Index Terms — Face recognition, modality gap, heterogeneous face recognition, composite sketch, forensic sketch, component based face representation. I.
Keyphrases
composite sketch rank-100 accuracy component-based approach face photo similarity score forensic sketch law enforcement agency face representation sketch recognition large gallery component similarity several facial composite software system heterogeneous face recognition professional artist individual facial component multiscale local binary pattern gender information prototype system great value subject appearance modality gap detect facial landmark facial component mugshot photograph commercial face recognition system facial photograph mugshot image sketch hand active shape model previous research timely fashion index term face recognition experimental result verbal description
