MetaCart Sign in to MyCiteSeerX

Include Citations | Advanced Search | Help

Disambiguated Search | Include Citations | Advanced Search | Help

The Context-Tree Weighting Method: Basic Properties (1996) [82 citations — 8 self]

Abstract:

Introduction At the IEEE ISIT in Budapest in 1991 we agreed that Yuri would come to Eindhoven the next year. Supported by the Universiteitsfonds Eindhoven, whose chairman was Jack van Lint at that time, Yuri visited the Information Theory group in May 1992. We decided to investigate universal source coding algorithms for FSMX sources, like e.g. the method proposed by Rissanen in [5]. It was our idea that these algorithms were designed to have a good asymptotical behavior while the non-asymptotical performance, which is important in real life, was not very well understood. After a while we realized that the idea of selecting relevant contexts was not a good one. This prevented researchers to determine the non-asymptotical behavior of their methods. An obvious alternative was weighting, an almost classical procedure. This way of thinking more or less immediately led to the context-tree weighting (CTW) algorithm. The CTW algorithm follows from first principles and combines a desir

Citations

4923 Elements of Information Theory – Cover, Thomas - 1991
202 Universal coding, information, prediction, and estimation – Rissanen - 1984
112 A universal data compression system – Rissanen - 1983
80 The performance of universal encoding – Krichevsky, Trofimov - 1981
72 Generalized Kraft Inequality and Arithmetic Coding – Rissanen - 1976
72 Universal sequential coding of single messages – Shtarkov - 1987
41 Source Coding Algorithm for Fast Data Compression – Pasco - 1976
35 Enumerative Source Encoding – Cover - 1973
9 Trofimov, "The performance of universal encoding – Krichevsky, K - 1981
2 The context tree weighting method : Truncated updating," submitted to IEEE Trans. lnfarn. Theor – Willems - 1994
1 Elements of Information Theory'. New Ymk – Cover, Thomas - 1991
1 universal data compression syslcm – unknown authors - 1983
1 Complexio – Stochasl& - 1989
1 Universal modeling and codiug – Jr - 1981
1 A mathematical theory of communicatiou," Bell Syst – Shannon - 1948