MetaCart Sign in to MyCiteSeerX

Include Citations | Advanced Search | Help

Disambiguated Search | Include Citations | Advanced Search | Help

Consistent Hashing and Random Trees: Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web (1997) [339 citations — 9 self]

by David Karger ,  Eric Lehman ,  Tom Leighton ,  Mathhew Levine ,  Daniel Lewin ,  Rina Panigrahy
In ACM Symposium on Theory of Computing
Add To MetaCart

Abstract:

We describe a family of caching protocols for distributed networks that can be used to decrease or eliminate the occurrence of hot spots in the network. Our protocols are particularly designed for use with very large networks such as the Internet, where delays caused by hot spots can be severe, and where it is not feasible for every server to have complete information about the current state of the entire network. The protocols are easy to implement using existing network protocols such as TCP/IP, and require very little overhead. The protocols work with local control, make efficient use of existing resources, and scale gracefully as the network grows. Our caching protocols are based on a special kind of hashing that we call consistent hashing. Roughly speaking, a consistent hash function is one which changes minimally as the range of the function changes. Through the development of good consistent hash functions, we are able to develop caching protocols which do not require users to ...

Citations

433 A hierarchical Internet object cache – Chankhunthod, Danszig, et al. - 1996
377 Efficient Dispersal of Information for Security, Load Balancing and Fault Tolerance – Rabin - 1989
308 The availability of quorum systems – Peleg, Wool - 1995
73 Making world wide web caching servers cooperate – Malpani, Berger - 1995
69 The Load, capacity and availability of quorum systems – Naor, Wool - 1994
64 Chernoff-Hoeffding bounds for applications with limited independence – Schmidt, Siegel, et al. - 1995
51 Design and implementation of DDH: A distributed dynamic hashing algorithm – Devine - 1993
47 Thekkath. Implementing global memory management in a workstation cluster – Feeley, Morgan, et al. - 1995
9 Fast fault-tolerant concurrent access to shared objects – Plaxton, Rajaraman - 1996
5 McCanne, Ching-Gung Liu and Lixia Zhang. A Reliable Multicast Framework – Floyd, Jacobson - 1995