• Documents
  • Authors
  • Tables
  • Log in
  • Sign up
  • MetaCart
  • DMCA
  • Donate

CiteSeerX logo

Advanced Search Include Citations
Advanced Search Include Citations

Recent advances in visual and infrared face recognition - a review. Computer Vision and Image Understanding 97, (2005)

by S G Kong, J Heo, B R Abidi, J Paik, M A Abidi
Add To MetaCart

Tools

Sorted by:
Results 1 - 10 of 105
Next 10 →

User Authentication via Adapted Statistical Models of Face Images

by Fabien Cardinaux, Conrad Sanderson, Samy Bengio , 2006
"... It has been previously demonstrated that systems based on local features and relatively complex statistical models, namely, one-dimensional (1-D) hidden Markov models (HMMs) and pseudo-two-dimensional (2-D) HMMs, are suitable for face recognition. Recently, a simpler statistical model, namely, th ..."
Abstract - Cited by 61 (10 self) - Add to MetaCart
It has been previously demonstrated that systems based on local features and relatively complex statistical models, namely, one-dimensional (1-D) hidden Markov models (HMMs) and pseudo-two-dimensional (2-D) HMMs, are suitable for face recognition. Recently, a simpler statistical model, namely, the Gaussian mixture model (GMM), was also shown to perform well. In much of the literature devoted to these models, the experiments were performed with controlled images (manual face localization, controlled lighting, background, pose, etc). However, a practical recognition system has to be robust to more challenging conditions. In this article we evaluate, on the relatively difficult BANCA database, the performance, robustness and complexity of GMM and HMM-based approaches, using both manual and automatic face localization. We extend the GMM approach through the use of local features with embedded positional information, increasing performance without sacrificing its low complexity. Furthermore, we show that the traditionally used maximum likelihood (ML) training approach has problems estimating robust model parameters when there is only a few training images available. Considerably more precise models can be obtained through the use of Maximum a posteriori probability (MAP) training. We also show that face recognition techniques which obtain good performance on manually located faces do not necessarily obtain good performance on automatically located faces, indicating that recognition techniques must be designed from the ground up to handle imperfect localization. Finally, we show that while the pseudo-2-D HMM approach has the best overall performance, authentication time on current hardware makes it impractical. The best tradeoff in terms of authentication ...

On transforming statistical models for non-frontal face verification

by Conrad Sanderson, Samy Bengio , Yongsheng Gao , 2006
"... We address the pose mismatch problem which can occur in face verification systems that have only a single (frontal) face image available for training. In the framework of a Bayesian classifier based on mixtures of gaussians, the problem is tackled through extending each frontal face model with artif ..."
Abstract - Cited by 31 (2 self) - Add to MetaCart
We address the pose mismatch problem which can occur in face verification systems that have only a single (frontal) face image available for training. In the framework of a Bayesian classifier based on mixtures of gaussians, the problem is tackled through extending each frontal face model with artificially synthesized models for non-frontal views. The synthesis methods are based on several implementations of maximum likelihood linear regression (MLLR), as well as standard multi-variate linear regression (LinReg). All synthesis techniques rely on prior information and learn how face models for the frontal view are related to face models for non-frontal views. The synthesis and extension approach is evaluated by applying it to two face verification systems: a holistic system (based on PCA-derived features) and a local feature system (based on DCT-derived features). Experiments on the FERET database suggest that for the holistic system, the LinReg-based technique is more suited than the MLLR-based techniques; for the local feature system, the results show that synthesis via a new MLLR implementation obtains better performance than synthesis based on traditional MLLR. The results further suggest that extending frontal models considerably reduces errors. It is also shown that the local feature system is less affected by view changes than the holistic system; this can be attributed to the parts based representation of the face, and, due to the classifier based on mixtures of gaussians, the lack of constraints on spatial relations between the face parts, allowing for deformations and movements of face areas.

Fusion of visual and thermal signatures with eyeglass removal for robust face recognition

by Jingu Heo, Seong G. Kong, Besma R. Abidi, Mongi A. Abidi - In Proc. IEEE International Workshop on Object Tracking and Classification Beyond the Visible Spectrum (OTCBVS , 2004
"... Abstract – This paper describes a fusion of visual and thermal infrared (IR) images for robust face recognition. Two types of fusion methods are discussed: data fusion and decision fusion. Data fusion produces an illumination-invariant face image by adaptively integrating registered visual and therm ..."
Abstract - Cited by 23 (5 self) - Add to MetaCart
Abstract – This paper describes a fusion of visual and thermal infrared (IR) images for robust face recognition. Two types of fusion methods are discussed: data fusion and decision fusion. Data fusion produces an illumination-invariant face image by adaptively integrating registered visual and thermal face images. Decision fusion combines matching scores of individual face recognition modules. In the data fusion process, eyeglasses, which block thermal energy, are detected from thermal images and replaced with an eye template. Three fusion-based face recognition techniques are implemented and tested: Data fusion of visual and thermal images (Df), Decision fusion with highest matching score (Fh), and Decision fusion with average matching score (Fa). A commercial face recognition software FaceIt ® is used as an individual recognition module. Comparison results show that fusion-based face recognition techniques outperformed individual visual and thermal face recognizers under illumination variations and facial expressions. I.
(Show Context)

Citation Context

...l features in the face increased face recognition accuracy [11]. The combined use of visual and thermal IR image data makes a viable means for improving the performance offace recognition techniques =-=[12]-=-. Face recognition algorithms applied to the fusion of visible and thermal IR images consistently demonstrated better performance than when applied to either visible or thermal IR imagery alone [13]. ...

How effective are landmarks and their geometry for face recognition?

by J. Shi , A. Samal , D. Marx , 2006
"... ..."
Abstract - Cited by 22 (2 self) - Add to MetaCart
Abstract not found

3D Shape-based Face Representation and Feature Extraction for Face Recognition

by Berk Gökberk, M. Okan Irfanoglu, Lale Akarun - IVC , 2006
"... In this paper, we review and compare 3D face registration and recognition algorithms which are based solely on 3D shape information and analyze methods based on the fusion of shape features. We have analyzed two different registration algorithms which produce a dense correspondence between faces. Th ..."
Abstract - Cited by 21 (1 self) - Add to MetaCart
In this paper, we review and compare 3D face registration and recognition algorithms which are based solely on 3D shape information and analyze methods based on the fusion of shape features. We have analyzed two different registration algorithms which produce a dense correspondence between faces. The first algorithm non-linearly warps faces to obtain registration, while the second algorithm allows only rigid transformations. Registration is handled with the use of an average face model which significantly fastens the registration process. As 3D facial features, we compare the use of 3D point coordinates, surface normals, curvature-based descriptors, 2D depth images, and facial profile curves. Except for surface normals, these feature descriptors are frequently used in state-of-the-art 3D face recognizers. We also perform an in-depth analysis of decision-level fusion techniques such as fixedrules, voting schemes, rank-based combination rules, and novel serial fusion architectures. The results of the recognition and authentication experiments conducted on the 3D_RMA database indicate that: (i) in terms of face registration method, registration of faces without warping preserves more discriminatory information, (ii) in terms of 3D facial features, surface normals attain the best recognition performance, and (iii) fusion schemes such as product rules, improved consensus voting and proposed serial fusion schemes improve the classification accuracy. Experimental results on the 3D_RMA confirm these findings by obtaining %0.1 misclassification rate in recognition experiments, and %8.06 equal error rate in authentication experiments using surface normal-based features. It is also possible to improve the classification accuracy by %2.38 using fixed fusion rules when moderate-level classifiers are used.

A manifold approach to face recognition from low quality video across illumination and pose using implicit super-resolution. ICCV

by Ognjen Arandjelović, Roberto Cipolla , 2007
"... We consider the problem of matching a face in a low resolution query video sequence against a set of higher quality gallery sequences. This problem is of interest in many applications, such as law enforcement. Our main contribution is an extension of the recently proposed Generic Shape-Illumination ..."
Abstract - Cited by 19 (0 self) - Add to MetaCart
We consider the problem of matching a face in a low resolution query video sequence against a set of higher quality gallery sequences. This problem is of interest in many applications, such as law enforcement. Our main contribution is an extension of the recently proposed Generic Shape-Illumination Manifold (gSIM) framework. Specifically, (i) we show how super-resolution across pose and scale can be achieved implicitly, by off-line learning of subsampling artefacts; (ii) we use this result to propose an extension to the statistical model of the gSIM by compounding it with a hierarchy of subsampling models at multiple scales; and (iii) we describe an extensive empirical evaluation of the method on over 1300 video sequences – we first measure the degradation in performance of the original gSIM algorithm as query sequence resolution is decreased and then show that the proposed extension produces an error reduction in the mean recognition rate of over 50%. 1.
(Show Context)

Citation Context

...earch. 2. Previous Work In this section we focus on previous work on superresolution and, in particular, super-resolution for face recognition; recent general face recognition reviews can be found in =-=[15, 24]-=- Broadly speaking, super-resolution concerns the problem of reconstructing high-resolution data from a single or multiple low resolution observations. Formally, the process of making a single observat...

Multimodal Face Recognition: Combination of Geometry with . . .

by I. A. Kakadiaris, G. Passalis, T. Theoharis, G. Toderici, I. Konstantinidis, N. Murtuza - IN PROC. IEEE CONF. ON CVPR , 2005
"... It is becoming increasingly important to be able to credential and identify authorized personnel at key points of entry. Such identity management systems commonly employ biometric identifiers. In this paper, we present a novel multimodal facial recognition approach that employs data from both visibl ..."
Abstract - Cited by 17 (2 self) - Add to MetaCart
It is becoming increasingly important to be able to credential and identify authorized personnel at key points of entry. Such identity management systems commonly employ biometric identifiers. In this paper, we present a novel multimodal facial recognition approach that employs data from both visible spectrum and thermal infrared sensors. Data from multiple cameras is used to construct a threedimensional mesh representing the face and a facial thermal texture map. An annotated face model with explicit two-dimensional parameterization (UV) is then fitted to this data to construct: 1) a three-channel UV deformation image encoding geometry, and 2) a one-channel UV vasculature image encoding facial vasculature. Recognition is accomplished by comparing: 1) the parametric deformation images, 2) the parametric vasculature images, and 3) the visible spectrum texture maps. The novelty of our work lies in the use of deformation images and physiological information as means for comparison. We have performed extensive tests on the Face Recognition Grand Challenge v1.0 dataset and on our own multimodal database with very encouraging results.

A Mosaicing Scheme for Pose-Invariant Face Recognition

by Richa Singh, Student Member, Mayank Vatsa, Student Member, Arun Ross, Afzel Noore
"... Abstract—Mosaicing entails the consolidation of information represented by multiple images through the application of a registration and blending procedure. We describe a face mosaicing scheme that generates a composite face image during enrollment based on the evidence provided by frontal and semip ..."
Abstract - Cited by 13 (2 self) - Add to MetaCart
Abstract—Mosaicing entails the consolidation of information represented by multiple images through the application of a registration and blending procedure. We describe a face mosaicing scheme that generates a composite face image during enrollment based on the evidence provided by frontal and semiprofile face images of an individual. Face mosaicing obviates the need to store multiple face templates representing multiple poses of a user’s face image. In the proposed scheme, the side profile images are aligned with the frontal image using a hierarchical registration algorithm that exploits neighborhood properties to determine the transformation relating the two images. Multiresolution splining is then used to blend the side profiles with the frontal image, thereby generating a composite face image of the user. A texture-based face recognition technique that is a slightly modified version of the C2 algorithm proposed by Serre et al. is used to compare a probe face image with the gallery face mosaic. Experiments conducted on three different databases indicate that face mosaicing, as described in this paper, offers significant benefits by accounting for the pose variations that are commonly observed in face images. Index Terms—Face mosaicing, face recognition, multiresolution splines, mutual information. I.

Fusion of Visual, Thermal and Range as A Solution to Illumination and Pose

by Besma Abidi, Shafik Huq, Mongi Abidi - Restrictions in Face Recognition”, Proceedings of the IEEE 38th Annual 2004 International Carnahan Conference on Security Technology, Albuquerque, NM, United states , 2004
"... Abstract – This paper summarizes the various components of face recognition research conducted at the IRIS Lab. First, fusion of visual and thermal infrared (IR) images for robust face recognition is discussed. Two techniques are implemented: data fusion and decision fusion. With the knowledge that ..."
Abstract - Cited by 12 (3 self) - Add to MetaCart
Abstract – This paper summarizes the various components of face recognition research conducted at the IRIS Lab. First, fusion of visual and thermal infrared (IR) images for robust face recognition is discussed. Two techniques are implemented: data fusion and decision fusion. With the knowledge that eyeglasses block the emission of thermal energy, an algorithm is designed to detect and replace eyeglasses with an eye template in thermal images. A commercial face recognition software (FaceIt ® ) is used in the evaluation of the various fusion algorithms. Comparison results show that fusion-based face recognition outperforms individual visual or thermal face recognizers under illumination variations and facial expressions. Efforts in the 3D arena are also described. Results of high resolution stereo-based 3D reconstruction of faces are shown and analyzed, in a first approach, then in a second approach, a warping technique is applied to overlay color and thermal textures on 3D mannequin head models, obtained using a laser range scanner. I.
(Show Context)

Citation Context

...ce was shown to increase face recognition accuracy [Fan02]. The combined use of visual and thermal IR image data constitutes a viable means of improving the performance of face recognition techniques =-=[Kon04]-=- [Wil96]. A. Fusion Algorithms Figure 1 shows a schematic diagram of the face recognition approaches discussed in this section. Data fusion (Df) produces illumination-invariant face images by adaptive...

Highly accurate and fast face recognition using near infrared images

by Stan Z. Li, Rufeng Chu, Meng Ao, Lun Zhang, Ran He - in Proc. IAPR Int. Conf. Biometrics , 2006
"... Abstract. In this paper, we present a highly accurate, realtime face recognition system for cooperative user applications. The novelties are: (1) a novel design of camera hardware, and (2) a learning based procedure for effective face and eye detection and recognition with the resulting imagery. The ..."
Abstract - Cited by 12 (3 self) - Add to MetaCart
Abstract. In this paper, we present a highly accurate, realtime face recognition system for cooperative user applications. The novelties are: (1) a novel design of camera hardware, and (2) a learning based procedure for effective face and eye detection and recognition with the resulting imagery. The hardware minimizes environmental lighting and delivers face images with frontal lighting. This avoids many problems in subsequent face processing to a great extent. The face detection and recognition algorithms are based on a local feature representation. Statistical learning is applied to learn most effective features and classifiers for building face detection and recognition engines. The novel imaging system and the detection and recognition engines are integrated into a powerful face recognition system. Evaluated in real-world user scenario, a condition that is harder than a technology evaluation such as Face Recognition Vendor Tests (FRVT), the system has demonstrated excellent accuracy, speed and usability. 1
(Show Context)

Citation Context

...eceived increased attention in the computer vision community, as seen from the IEEE workshop series [6, 13]. Thermal or far infrared imagery has been used for face recognition (cf. and a survey paper =-=[10]-=-). While thermal based face recognition systems are advantages for detecting disguised faces or when there is no control over illumination, they are subject to environmental temperature, emotional and...

Powered by: Apache Solr
  • About CiteSeerX
  • Submit and Index Documents
  • Privacy Policy
  • Help
  • Data
  • Source
  • Contact Us

Developed at and hosted by The College of Information Sciences and Technology

© 2007-2019 The Pennsylvania State University