DMCA
Decision Level Fusion of Domain Specific Regions for Facial Action Recognition
| Citations: | 3 - 1 self |
BibTeX
@MISC{Jiang_decisionlevel,
author = {Bihan Jiang and Brais Martinez and Michel F. Valstar and Maja Pantic},
title = {Decision Level Fusion of Domain Specific Regions for Facial Action Recognition},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Abstract—In this paper we propose a new method for the detection of action units that relies on a novel region-based face representation and a mid-level decision layer that combines region-specific information. Different from other approaches, we do not represent the face as a regular grid based on the face location alone (holistic representation), nor by using small patches centred at fiducial facial point locations (local representation). In-stead, we propose to use domain knowledge regarding AU-specific facial muscle contractions to define a set of face regions covering the whole face. Therefore, as opposed to local appearance models, our face representation makes use of the full facial appearance, while the use of facial point locations to define the regions means that we obtain better-registered descriptors compared to holistic representations. Finally, we propose an AU-specific weighted sum model is used as a decision-level fusion layer in charge of combining region-specific probabilistic information. This configuration allows each classifier to learning the typical appearance changes for a specific face part and reduces the dimensionality of the problem thus proving to be more robust. Our approach is evaluated on the DISFA and GEMEP-FERA datasets using two histogram-based appearance features, Local Binary Pattern and Local Phase Quantisation. We show superior performance for both the domain-specific region definition and the decision-level fusion respect to the standard approaches when it comes to automatic facial action unit detection. I.
Keyphrases
decision level fusion domain specific region facial action recognition holistic representation face location full facial appearance superior performance regular grid face region local binary pattern domain knowledge action unit region-specific information whole face novel region-based face representation small patch gemep-fera datasets decision-level fusion respect specific face part face representation decision-level fusion layer new method au-specific weighted sum model automatic facial action unit detection local representation local phase quantisation region-specific probabilistic information au-specific facial muscle contraction mid-level decision layer better-registered descriptor histogram-based appearance feature local appearance model facial point location domain-specific region definition typical appearance change fiducial facial point location
