Abstract

We investigate the efficiency of lossy algorithmic representations of information and show that "Complexity Distortion" is asymptotically equivalent to Rate Distortion for stationary ergodic sources. I. Introduction The concept of efficiently representing information dates back to the late 40's with the pioneering work of C. E. Shannon. Since then, compression has been a continuously growing research field with numerous fundamental contributions to communication system design and implemention. Several diverse techniques have emerged recently, including fractals, modelbased coding, and sophisticated programmable designs that allow flexibility and extensibility via downloadable code [2]. Most of these techniques cannot be analyzed within traditional theoretical frameworks. We propose a new theory, called Complexity Distortion Theory, which uses complexities or length of lossy descriptions to provide a much broader and unifying perspective on media representation. The key component of t...

Citations