DMCA
Multimodal fusion for multimedia analysis: a survey (2010)
| Citations: | 58 - 1 self |
BibTeX
@MISC{Atrey10multimodalfusion,
author = {P. K. Atrey and M. A. Hossain and Abdulmotaleb El Saddik and Mohan S. Kankanhalli},
title = { Multimodal fusion for multimedia analysis: a survey},
year = {2010}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
This survey aims at providing multimedia researchers with a state-of-the-art overview of fusion strategies, which are used for combining multiple modalities in order to accomplish various multimedia analysis tasks. The existing literature on multimodal fusion research is presented through several classifications based on the fusion methodology and the level of fusion (feature, decision, and hybrid). The fusion methods are described from the perspective of the basic concept, advantages, weaknesses, and their usage in various analysis tasks as reported in the literature. Moreover, several distinctive issues that influence a multimodal fusion process such as, the use of correlation and independence, confidence level, contextual information, synchronization between different modalities, and the optimal modality selection are also highlighted. Finally, we present the open issues for further research in the area of multimodal fusion.
Keyphrases
multimodal fusion multimedia analysis multiple modality optimal modality selection fusion method state-of-the-art overview various multimedia analysis task basic concept multimodal fusion process several classification various analysis task different modality contextual information fusion methodology multimedia researcher open issue confidence level multimodal fusion research fusion strategy several distinctive issue
