Abstract:
Context weighting procedures are presented for sources with models (structures) in four different classes. Although the procedures are designed for universal data compression purposes, their generality allows application in the area of classification. 1 Introduction Recently in [14],[15] the authors introduced context-tree weighting as a sequential universal source coding method for the class of binary (bounded memory) tree sources. Tree sources were defined around the same time by Weinberger et al. [13]. The idea behind context weighting procedures can be summarized as follows 1 : The well known Elias algorithm (described in e.g. Jelinek [1]) produces for any coding distribution P c (x T 1 ) over all binary sequences of length T , a binary prefix code with codeword lengths L(x T 1 ) that satisfy L(x T 1 ) ! log 1 P c (x T 1 ) + 2 for all x T 1 : (1) (We assume that the base of the log(\Delta) is 2. Codeword lengths and information quantities are expressed in bits.) If th...
Citations
|
385
|
Stochastic Complexity
– Rissanen
- 1987
|
|
251
|
Inferring decision trees using the minimum description length principle
– Quinlan, Rivest
- 1989
|
|
202
|
Universal coding, information, prediction, and estimation
– Rissanen
- 1984
|
|
82
|
The context-tree weighting method: basic properties
– Willems, Shtarkov, et al.
- 1995
|
|
80
|
The performance of universal encoding
– Krichevsky, Trofimov
- 1981
|
|
55
|
A Universal Finite Memory Source
– Weinberger, Rissanen, et al.
- 1995
|
|
32
|
Optimal Sequential Probability Assignment for Individual Sequences
– Weinberger, Merhav, et al.
- 1994
|
|
30
|
Probabilistic Information Theory
– Jelinek
- 1968
|
|
28
|
A Sequential Algorithm for the Universal Coding of Finite Memory Sources
– Weinberger, Lempel, et al.
- 1992
|
|
9
|
Some Topics in Descriptive Complexity
– Nohre
- 1994
|
|
4
|
Context Tree Weighting : A Sequential Universal Source Coding Procedure for FSMX Sources
– Willems, Shtarkov, et al.
- 1993
|
|
1
|
The Connection between the Redundancy and the Reliability of Information about the Source
– Krichevsky
- 1968
|
|
1
|
Ryabko, "Twice-Universal Coding," Probl
– Ya
- 1984
|
|
1
|
Methods of Constructing Lower Bounds for Redundancy of Universal Coding
– Shtarkov
- 1982
|
|
1
|
The Redundancy of Universal Encoding of Arbitrary Markov Sources
– Trofimov
- 1974
|