N-Gram-Based Text Categorization (1994) [143 citations — 0 self]
http://www.novodynamics.com/trenkle/papers/sdair-9
http://www.info.unicaen.fr/~giguet/classif/cavnar_
CiteULike
CACHED:
|
Popular Tags
No tags have been applied to this document.
BibTeX | Add To MetaCart
author = {William B. Cavnar and John M. Trenkle},
title = {N-Gram-Based Text Categorization},
booktitle = {In Proceedings of SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval},
year = {1994},
pages = {161--175}
}
Years of Citing Articles
Bookmarks
OpenURL
Abstract:
Text categorization is a fundamental task in document processing, allowing the automated handling of enormous streams of documents in electronic form. One difficulty in handling some classes of documents is the presence of different kinds of textual errors, such as spelling and grammatical errors in email, and character recognition errors in documents that come through OCR. Text categorization must work reliably on all input, and thus must tolerate some level of these kinds of problems. We describe here an N-gram-based approach to text categorization that is tolerant of textual errors. The system is small, fast and robust. This system worked very well for language classification, achieving in one test a 99.8% correct classification rate on Usenet newsgroup articles written in different languages. The system also worked reasonably well for classifying articles from a number of different computer-oriented newsgroups according to subject, achieving as high as an 80% correct classification...
Citations
No citations identified.
