DMCA
The TRECVID 2007 BBC rushes summarization evaluation pilot
| Venue: | in TVS ’07, 2007 |
| Citations: | 37 - 3 self |
BibTeX
@INPROCEEDINGS{Over_thetrecvid,
author = {Paul Over and Alan F. Smeaton and Philip Kelly},
title = {The TRECVID 2007 BBC rushes summarization evaluation pilot},
booktitle = {in TVS ’07, 2007},
year = {},
pages = {1--15}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
This paper provides an overview of a pilot evaluation of video summaries using rushes from several BBC dramatic series. It was carried out under the auspices of TRECVID. Twenty-two research teams submitted video summaries of up to 4 % duration, of 42 individual rushes video les aimed at compressing out redundant and insignicant material. The output of two baseline systems built on straightforward content reduction techniques was contributed by Carnegie Mellon University as a control. Procedures for developing ground truth lists of important segments from each video were developed at Dublin City University and applied to the BBC video. At NIST each summary was judged by three humans with respect to how much of the ground truth was included, how easy the summary was to understand, and how much repeated material the summary contained. Additional objective measures included: how long it took the system to create the summary, how long it took the as-sessor to judge it against the ground truth, and what the summary's duration was. Assessor agreement on nding de-sired segments averaged 78 % and results indicate that while it is dicult to exceed the performance of baselines, a few systems did. 1
Keyphrases
bbc rush summarization evaluation pilot video summary ground truth de-sired segment individual rush baseline system several bbc dramatic series pilot evaluation bbc video ground truth list straightforward content reduction technique twenty-two research team additional objective measure carnegie mellon university insignicant material assessor agreement important segment dublin city university
