Building a distributed full-text index for the web (2001)
Cached
Download Links
| Venue: | ACM Trans. Inf. Syst |
| Citations: | 63 - 3 self |
BibTeX
@INPROCEEDINGS{Melnik01buildinga,
author = {Sergey Melnik and Sriram Raghavan and Beverly Yang and Hector Garcia-molina},
title = {Building a distributed full-text index for the web},
booktitle = {ACM Trans. Inf. Syst},
year = {2001},
pages = {396--406}
}
Years of Citing Articles
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
We identify crucial design issues in building a distributed inverted index for a large collection of Web pages. We introduce a novel pipelining technique for structuring the core index-building system that substantially reduces the index construction time. We also propose a storage scheme for creating and managing inverted files using an embedded database system. We suggest and compare different strategies for collecting global statistics from distributed inverted indexes. Finally, we present performance results from experiments on a testbed distributed Web indexing system that we have implemented.
