DMCA
Information-theoretic tools for mining database structure from large data sets (2004)
Cached
Download Links
- [www.cs.uiuc.edu]
- [www.cs.uoi.gr]
- [www.cs.toronto.edu]
- [dblab.cs.toronto.edu]
- DBLP
Other Repositories/Bibliography
| Venue: | In SIGMOD |
| Citations: | 25 - 3 self |
BibTeX
@INPROCEEDINGS{Andritsos04information-theoretictools,
author = {Periklis Andritsos and Renée J. Miller and Panayiotis Tsaparas},
title = {Information-theoretic tools for mining database structure from large data sets},
booktitle = {In SIGMOD},
year = {2004},
pages = {731--742}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Data design has been characterized as a process of arriving at a design that maximizes the information content of each piece of data (or equivalently, one that minimizes redundancy). Information content (or redundancy) is measured with respect to a prescribed model for the data, a model that is often expressed as a set of constraints. In this work, we consider the problem of doing data redesign in an environment where the prescribed model is unknown or incomplete. Specifically, we consider the problem of finding structural clues in an instance of data, an instance which may contain errors, missing values, and duplicate records. We propose a set of information-theoretic tools for finding structural summaries that are useful in characterizing the information content of the data, and ultimately useful in data design. We provide algorithms for creating these summaries over large, categorical data sets. We study the use of these summaries in one specific physical design task, that of ranking functional dependencies based on their data redundancy. We show how our ranking can be used by a physical data-design tool to find good vertical decompositions of a relation (decompositions that improve the information content of the design). We present an evaluation of the approach on real data sets. 1.
Keyphrases
information content information-theoretic tool large data set database structure prescribed model data design functional dependency duplicate record physical data-design tool data redundancy structural clue data redesign categorical data set real data set structural summary good vertical decomposition specific physical design task
