Finding near-replicas of documents on the Web (1998)
Cached
Download Links
| Venue: | In International Workshop on the World Wide Web and Databases (WebDB’98 |
| Citations: | 54 - 0 self |
BibTeX
@INPROCEEDINGS{Shivakumar98findingnear-replicas,
author = {Narayanan Shivakumar and Hector Garcia-molina},
title = {Finding near-replicas of documents on the Web},
booktitle = {In International Workshop on the World Wide Web and Databases (WebDB’98},
year = {1998},
pages = {204--212}
}
Years of Citing Articles
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
We consider how to e ciently compute the overlap between all pairs of web documents. This information can be used to improve web crawlers, web archivers and in the presentation of search results, among others. We report statistics on how common replication is on the web, and on the cost of computing the above information for a relatively large subset of the web { about 24 million web pages which corresponds to about 150 Gigabytes of textual information. 1
