MetaCart Sign in to MyCiteSeerX

Include Citations | Advanced Search | Help

Disambiguated Search | Include Citations | Advanced Search | Help

Context Weighting for General Finite-Context Sources (1996) [10 citations — 0 self]

by Frans M. J. Willems ,  Yuri M. Shtarkov ,  Tjalling J. Tjalkens
IEEE Trans. Inform. Theory
Add To MetaCart

Abstract:

Context weighting procedures are presented for sources with models (structures) in four different classes. Although the procedures are designed for universal data compression purposes, their generality allows application in the area of classification. 1 Introduction Recently in [14],[15] the authors introduced context-tree weighting as a sequential universal source coding method for the class of binary (bounded memory) tree sources. Tree sources were defined around the same time by Weinberger et al. [13]. The idea behind context weighting procedures can be summarized as follows 1 : The well known Elias algorithm (described in e.g. Jelinek [1]) produces for any coding distribution P c (x T 1 ) over all binary sequences of length T , a binary prefix code with codeword lengths L(x T 1 ) that satisfy L(x T 1 ) ! log 1 P c (x T 1 ) + 2 for all x T 1 : (1) (We assume that the base of the log(\Delta) is 2. Codeword lengths and information quantities are expressed in bits.) If th...

Citations

385 Stochastic Complexity – Rissanen - 1987
251 Inferring decision trees using the minimum description length principle – Quinlan, Rivest - 1989
202 Universal coding, information, prediction, and estimation – Rissanen - 1984
82 The context-tree weighting method: basic properties – Willems, Shtarkov, et al. - 1995
80 The performance of universal encoding – Krichevsky, Trofimov - 1981
55 A Universal Finite Memory Source – Weinberger, Rissanen, et al. - 1995
32 Optimal Sequential Probability Assignment for Individual Sequences – Weinberger, Merhav, et al. - 1994
30 Probabilistic Information Theory – Jelinek - 1968
28 A Sequential Algorithm for the Universal Coding of Finite Memory Sources – Weinberger, Lempel, et al. - 1992
9 Some Topics in Descriptive Complexity – Nohre - 1994
4 Context Tree Weighting : A Sequential Universal Source Coding Procedure for FSMX Sources – Willems, Shtarkov, et al. - 1993
1 The Connection between the Redundancy and the Reliability of Information about the Source – Krichevsky - 1968
1 Ryabko, "Twice-Universal Coding," Probl – Ya - 1984
1 Methods of Constructing Lower Bounds for Redundancy of Universal Coding – Shtarkov - 1982
1 The Redundancy of Universal Encoding of Arbitrary Markov Sources – Trofimov - 1974