Consistent Hashing and Random Trees: Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web (1997) [339 citations — 9 self]
Abstract:
We describe a family of caching protocols for distributed networks that can be used to decrease or eliminate the occurrence of hot spots in the network. Our protocols are particularly designed for use with very large networks such as the Internet, where delays caused by hot spots can be severe, and where it is not feasible for every server to have complete information about the current state of the entire network. The protocols are easy to implement using existing network protocols such as TCP/IP, and require very little overhead. The protocols work with local control, make efficient use of existing resources, and scale gracefully as the network grows. Our caching protocols are based on a special kind of hashing that we call consistent hashing. Roughly speaking, a consistent hash function is one which changes minimally as the range of the function changes. Through the development of good consistent hash functions, we are able to develop caching protocols which do not require users to ...
Citations
| 433 | A hierarchical Internet object cache – Chankhunthod, Danszig, et al. - 1996 |
| 377 | Efficient Dispersal of Information for Security, Load Balancing and Fault Tolerance – Rabin - 1989 |
| 308 | The availability of quorum systems – Peleg, Wool - 1995 |
| 73 | Making world wide web caching servers cooperate – Malpani, Berger - 1995 |
| 69 | The Load, capacity and availability of quorum systems – Naor, Wool - 1994 |
| 64 | Chernoff-Hoeffding bounds for applications with limited independence – Schmidt, Siegel, et al. - 1995 |
| 51 | Design and implementation of DDH: A distributed dynamic hashing algorithm – Devine - 1993 |
| 47 | Thekkath. Implementing global memory management in a workstation cluster – Feeley, Morgan, et al. - 1995 |
| 9 | Fast fault-tolerant concurrent access to shared objects – Plaxton, Rajaraman - 1996 |
| 5 | McCanne, Ching-Gung Liu and Lixia Zhang. A Reliable Multicast Framework – Floyd, Jacobson - 1995 |

