DMCA
Annotating Continuous Understanding in a Multimodal Dialogue Corpus. Decalog 2007
Cached
Download Links
| Citations: | 8 - 2 self |
BibTeX
@MISC{Gallo_annotatingcontinuous,
author = {Carlos Gómez Gallo and Gregory Aist and James Allen and William De Beaumont and Sergio Coria and Whitney Gegg-harrison and Joana Paulo Pardal and Mary Swift},
title = {Annotating Continuous Understanding in a Multimodal Dialogue Corpus. Decalog 2007},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
We describe an annotation scheme aimed at capturing continuous understanding behavior in a multimodal dialogue corpus involving referential description tasks. By using multilayer annotation at the word level as opposed to sentence level, we can better understand the role of continuous understanding in dialogue. To this end, we annotate referring expressions, spatial relations, and speech acts at the earliest word that clarifies the speaker’s intentions. Word-level annotation allows us to trace how referential expressions and actions are understood incrementally. Our corpus has intertwined language and actions which help identify the relationships between language usage, intention recognition, and contextual changes which in turn can be used to develop conversational agents that understand language in a continuous manner. 1
Keyphrases
multimodal dialogue corpus continuous understanding speech act speaker intention contextual change continuous manner word level referential expression multilayer annotation word-level annotation referential description task language usage annotation scheme conversational agent intention recognition spatial relation
