Native Judgments of Non-Native Usage: Experiments in Preposition Error Detection
by
Joel R. Tetreault
,
Martin Chodorow
| Citations: | 5 - 2 self |
BibTeX
@MISC{Tetreault_nativejudgments,
author = {Joel R. Tetreault and Martin Chodorow},
title = {Native Judgments of Non-Native Usage: Experiments in Preposition Error Detection},
year = {}
}
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
Evaluation and annotation are two of the greatest challenges in developing NLP instructional or diagnostic tools to mark grammar and usage errors in the writing of non-native speakers. Past approaches have commonly used only one rater to annotate a corpus of learner errors to compare to system output. In this paper, we show how using only one rater can skew system evaluation and then we present a sampling approach that makes it possible to evaluate a system more efficiently. 1
