CiteSeerX — Version 0: ON THE RELATION BETWEEN ADDITIVE SMOOTHING AND UNIVERSAL CODING

ON THE RELATION BETWEEN ADDITIVE SMOOTHING AND UNIVERSAL CODING

by Unknown Authors

Datum	Value	Source
TITLE	ON THE RELATION BETWEEN ADDITIVE SMOOTHING AND UNIVERSAL CODING	SVM HeaderParse 0.2
ABSTRACT	We analyze the performance of smoothing methods for language modeling from the perspective of universal compression. We use existing asymptotic bounds on the performance of simple additive rules for compression of finite-alphabet memoryless sources to explain the empirical predictive abilities of additive smoothing techniques. We further suggest a smoothing method that overcomes some of the problems observed in previous approaches. The new method outperforms existing ones on the Wall Street Journal(WSJ) database for bigram and trigram models. We then suggest possible directions for future research. 1.	SVM HeaderParse 0.2
CITATIONS	18 found	ParsCit 1.0