Towards Understanding Spontaneous Speech: Word Accuracy Vs. Concept Accuracy (1996)
Cached
Download Links
- [www.asel.udel.edu]
- [arxiv.org]
- [faui80.informatik.uni-erlangen.de]
- DBLP
Other Repositories/Bibliography
| Venue: | In Proceedings of the Fourth International Conference on Spoken Language Processing (ICSLP 96 |
| Citations: | 52 - 6 self |
BibTeX
@INPROCEEDINGS{Boros96towardsunderstanding,
author = {M. Boros and W. Eckert and F. Gallwitz and G. Görz and G. Hanrieder and H. Niemann},
title = {Towards Understanding Spontaneous Speech: Word Accuracy Vs. Concept Accuracy},
booktitle = {In Proceedings of the Fourth International Conference on Spoken Language Processing (ICSLP 96},
year = {1996},
pages = {1009--1012}
}
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
In this paper we describe an approach to automatic evaluation of both the speech recognition and understanding capabilities of a spoken dialogue system for train time table information. We use word accuracy for recognition and concept accuracy for understanding performance judgement. Both measures are calculated by comparing these modules' output with a correct reference answer. We report evaluation results for a spontaneous speech corpus with about 10000 utterances. We observed a nearly linear relationship between word accuracy and concept accuracy.
