DMCA
Early versus late fusion in semantic video analysis (2005)
Cached
Download Links
- [staff.science.uva.nl]
- [www.science.uva.nl]
- DBLP
Other Repositories/Bibliography
| Venue: | In ACM Multimedia |
| Citations: | 93 - 2 self |
BibTeX
@INPROCEEDINGS{Snoek05earlyversus,
author = {Cees G. M. Snoek},
title = {Early versus late fusion in semantic video analysis},
booktitle = {In ACM Multimedia},
year = {2005},
pages = {399--402}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Semantic analysis of multimodal video aims to index segments of interest at a conceptual level. In reaching this goal, it requires an analysis of several information streams. At some point in the analysis these streams need to be fused. In this paper, we consider two classes of fusion schemes, namely early fusion and late fusion. The former fuses modalities in feature space, the latter fuses modalities in semantic space. We show by experiment on 184 hours of broadcast video data and for 20 semantic concepts, that late fusion tends to give slightly better performance for most concepts. However, for those concepts where early fusion performs better the difference is more significant.
Keyphrases
semantic video analysis versus late fusion late fusion several information stream feature space index segment multimodal video aim conceptual level latter fuse modality semantic analysis broadcast video data semantic concept former fuse modality semantic space early fusion fusion scheme early fusion performs
