A review of recent corpus-based methods for evaluating information ordering in text production (2005)
| Venue: | In Proceedings of Corpus Linguistics 2005 Workshop on Using Corpora for NLG |
| Citations: | 4 - 2 self |
BibTeX
@INPROCEEDINGS{Karamanis05areview,
author = {Nikiforos Karamanis and Chris Mellish},
title = {A review of recent corpus-based methods for evaluating information ordering in text production},
booktitle = {In Proceedings of Corpus Linguistics 2005 Workshop on Using Corpora for NLG},
year = {2005},
pages = {13--18}
}
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
This paper surveys the corpus-based methods for evaluating Information Ordering (IO) which emerged recently in the literature on text production. First, we discuss how different assumptions about the input to IO make the preparation of corpora suitable for evaluation more challenging in Natural Language Generation than in Automatic Multidocument Summarisation. Then, we present the types of corpora and performance measures employed by the reviewed work emphasising the considerable consensus that has emerged in these two aspects of automatic evaluation of IO. 1
