Results 1  10
of
11
The Dimensions of Individual Strings and Sequences
 INFORMATION AND COMPUTATION
, 2003
"... A constructive version of Hausdorff dimension is developed using constructive supergales, which are betting strategies that generalize the constructive supermartingales used in the theory of individual random sequences. This constructive dimension is used to assign every individual (infinite, binary ..."
Abstract

Cited by 87 (11 self)
 Add to MetaCart
A constructive version of Hausdorff dimension is developed using constructive supergales, which are betting strategies that generalize the constructive supermartingales used in the theory of individual random sequences. This constructive dimension is used to assign every individual (infinite, binary) sequence S a dimension, which is a real number dim(S) in the interval [0, 1]. Sequences that
Logical Depth and Physical Complexity
 THE UNIVERSAL TURING MACHINE: A HALFCENTURY SURVEY
, 1988
"... Some mathematical and natural objects (a random sequence, a sequence of zeros, a perfect crystal, a gas) are intuitively trivial, while others (e.g. the human body, the digits of #) contain internal evidence of a nontrivial causal history. We formalize this ..."
Abstract

Cited by 54 (0 self)
 Add to MetaCart
Some mathematical and natural objects (a random sequence, a sequence of zeros, a perfect crystal, a gas) are intuitively trivial, while others (e.g. the human body, the digits of #) contain internal evidence of a nontrivial causal history. We formalize this
Hierarchies Of Generalized Kolmogorov Complexities And Nonenumerable Universal Measures Computable In The Limit
 INTERNATIONAL JOURNAL OF FOUNDATIONS OF COMPUTER SCIENCE
, 2000
"... The traditional theory of Kolmogorov complexity and algorithmic probability focuses on monotone Turing machines with oneway writeonly output tape. This naturally leads to the universal enumerable SolomonoLevin measure. Here we introduce more general, nonenumerable but cumulatively enumerable m ..."
Abstract

Cited by 40 (21 self)
 Add to MetaCart
(Show Context)
The traditional theory of Kolmogorov complexity and algorithmic probability focuses on monotone Turing machines with oneway writeonly output tape. This naturally leads to the universal enumerable SolomonoLevin measure. Here we introduce more general, nonenumerable but cumulatively enumerable measures (CEMs) derived from Turing machines with lexicographically nondecreasing output and random input, and even more general approximable measures and distributions computable in the limit. We obtain a natural hierarchy of generalizations of algorithmic probability and Kolmogorov complexity, suggesting that the "true" information content of some (possibly in nite) bitstring x is the size of the shortest nonhalting program that converges to x and nothing but x on a Turing machine that can edit its previous outputs. Among other things we show that there are objects computable in the limit yet more random than Chaitin's "number of wisdom" Omega, that any approximable measure of x is small for any x lacking a short description, that there is no universal approximable distribution, that there is a universal CEM, and that any nonenumerable CEM of x is small for any x lacking a short enumerating program. We briey mention consequences for universes sampled from such priors.
Recursively Enumerable Reals and Chaitin Ω Numbers
"... A real is called recursively enumerable if it is the limit of a recursive, increasing, converging sequence of rationals. Following Solovay [23] and Chaitin [10] we say that an r.e. real dominates an r.e. real if from a good approximation of from below one can compute a good approximation of from b ..."
Abstract

Cited by 35 (3 self)
 Add to MetaCart
A real is called recursively enumerable if it is the limit of a recursive, increasing, converging sequence of rationals. Following Solovay [23] and Chaitin [10] we say that an r.e. real dominates an r.e. real if from a good approximation of from below one can compute a good approximation of from below. We shall study this relation and characterize it in terms of relations between r.e. sets. Solovay's [23]like numbers are the maximal r.e. real numbers with respect to this order. They are random r.e. real numbers. The halting probability ofa universal selfdelimiting Turing machine (Chaitin's Ω number, [9]) is also a random r.e. real. Solovay showed that any Chaitin Ω number islike. In this paper we show that the converse implication is true as well: any Ωlike real in the unit interval is the halting probability of a universal selfdelimiting Turing machine.
Scaled dimension and nonuniform complexity
 Journal of Computer and System Sciences
, 2004
"... Resourcebounded dimension is a complexitytheoretic extension of classical Hausdorff dimension introduced by Lutz (2000) in order to investigate the fractal structure of sets that have resourcebounded measure 0. For example, while it has long been known that the Boolean circuitsize complexity cla ..."
Abstract

Cited by 22 (9 self)
 Add to MetaCart
Resourcebounded dimension is a complexitytheoretic extension of classical Hausdorff dimension introduced by Lutz (2000) in order to investigate the fractal structure of sets that have resourcebounded measure 0. For example, while it has long been known that the Boolean circuitsize complexity class SIZE � α 2n n has measure 0 in ESPACE for all 0 ≤ α ≤ 1, we now know that SIZE � α 2n n has dimension α in ESPACE for all 0 ≤ α ≤ 1. The present paper furthers this program by developing a natural hierarchy of “rescaled” resourcebounded dimensions. For each integer i and each set X of decision problems, we define the ithorder dimension of X in suitable complexity classes. The 0thorder dimension is precisely the dimension of Hausdorff (1919) and Lutz (2000). Higher and lower orders are useful for various sets X. For example, we prove the following for 0 ≤ α ≤ 1 and any polynomial q(n) ≥ n2. 1. The class SIZE(2 αn) and the time and spacebounded Kolmogorov complexity classes KT q (2 αn) and KS q (2 αn) have 1 storder dimension α in ESPACE. 2. The classes SIZE(2nα), KT q (2nα), and KS q (2nα) have 2ndorder dimension α in ESPACE.
Inductive Inference Theory  A Unified Approach To Problems In Pattern Recognition And Artificial Intelligence
 Proceedings of the 4th International Conference on Artificial Intelligence , pp 274 280
, 1975
"... Recent results in induction theory are reviewed that demonstrate the general adequacy of the induction system of Solomono# and Willis. Several problems in pattern recognition and A.I. are investigated through these methods. The theory is used to obtain the a priori probabilities that are necessa ..."
Abstract

Cited by 9 (3 self)
 Add to MetaCart
Recent results in induction theory are reviewed that demonstrate the general adequacy of the induction system of Solomono# and Willis. Several problems in pattern recognition and A.I. are investigated through these methods. The theory is used to obtain the a priori probabilities that are necessary in the application of stochastic languages to pattern recognition.
Why Computational Complexity Requires Stricter Martingales
"... The word "martingale " has related, but different, meanings in probability theory and theoretical computer science. In computational complexity and algorithmic information theory, a martingale is typically a function d on strings such that E(d(wb)w) = d(w) for all strings w, whe ..."
Abstract

Cited by 7 (0 self)
 Add to MetaCart
(Show Context)
The word &quot;martingale &quot; has related, but different, meanings in probability theory and theoretical computer science. In computational complexity and algorithmic information theory, a martingale is typically a function d on strings such that E(d(wb)w) = d(w) for all strings w, where the conditional expectation is computed over all possible values of the next symbol b. In modern probability theory a martingale is typically a sequence,0,,1,,2,... of random variables such that E(,n+1,0,...,,n) =,n for all n.
Sophistication Revisited
 Proceedings of the 30th International Colloquium on Automata, Languages and Programming
, 2001
"... The Kolmogorov structure function divides the smallest program producing a string in two parts: the useful information present in the string, called sophistication if based on total functions, and the remaining accidental information. We revisit the notion of sophistication due to Koppel, formal ..."
Abstract

Cited by 6 (5 self)
 Add to MetaCart
The Kolmogorov structure function divides the smallest program producing a string in two parts: the useful information present in the string, called sophistication if based on total functions, and the remaining accidental information. We revisit the notion of sophistication due to Koppel, formalize a connection between sophistication and a variation of computational depth (intuitively the useful or nonrandom information in a string), prove the existence of strings with maximum sophistication and show that they encode solutions of the halting problem, i.e., they are the deepest of all strings.
Effective category and measure in abstract complexity theory. Theoretical Computer Science 154
, 1996
"... ..."
Gales and the Dimensions of Individual Strings and Sequences
"... A constructive version of Hausdorff dimension is developed using constructive gales, which are betting strategies that generalize the constructive martingales used in the theory of individual random sequences. This constructive dimension is used to assign every individual (infinite, binary) sequence ..."
Abstract
 Add to MetaCart
(Show Context)
A constructive version of Hausdorff dimension is developed using constructive gales, which are betting strategies that generalize the constructive martingales used in the theory of individual random sequences. This constructive dimension is used to assign every individual (infinite, binary) sequence S a dimension, which is a real number dim(S) in the interval [0; 1]. Sequences that are random (in the sense of MartinLöf) have dimension 1, while sequences that are decidable, 0 1 , or 0 1 have dimension 0. It is shown that for every 0 2 computable real number in [0,1] there is a 0 2 sequence S such that dim(S) = : A discrete version of constructive dimension is also developed using termgales, which are galelike functions that bet on the terminations of (finite, binary) strings as well as on their successive bits. This discrete dimension is used to assign each individual string w a dimension, which is a nonnegative real number dim(w). The dimension of a sequence is shown to be the limit in mum of the dimensions of its prefixes. The Kolmogorov complexity of a string is proven to be the product of its length and its dimension. This gives a new characterization of algorithmic information and a new proof of Mayordomo's recent theorem stating that the dimension of a sequence is the limit in mum of the average Kolmogorov complexity of its first n bits. Every sequence that is random relative to any computable sequence of cointoss biases that converge to a real number in (0; 1) is shown to have dimension H( ), the binary entropy of .