This paper addresses the problem of churn---the continuous process of node arrival and departure---in distributed hash tables (DHTs). We demonstrate through experiment that existing DHT implementations break down at churn levels observed in deployed peer-to-peer systems, contrary to simulation-based results. We present Bamboo, a DHT that handles high levels of churn, and discuss the manner in which it does so. We show that Bamboo is able to function effectively for median node session times as short as 1.4 minutes, while using less than 900 bytes/s/node of maintenance bandwidth in a 1000-node system. This churn rate is faster than that observed in real file-sharing systems such as Gnutella, Kazaa, Napster, and Overnet. Since Bamboo's bandwidth usage scales logarithmically in the number of nodes, we expect this cost to remain within the reach of dialup modems even for very large systems. Moreover, in simulated networks without churn, Bamboo achieves lookup performance comparable with Pastry, an existing DHT with a similar structure.
|
2400
|
Chord: A scalable peer-to-peer lookup service for internet applications
– STOICA, MORRIS, et al.
- 2001
|
|
1960
|
A Scalable Content-Addressable Network
– Ratnasamy, Handley, et al.
|
|
1828
|
Congestion avoidance and control
– Jacobson
- 1988
|
|
1286
|
Pastry: Scalable, Distributed Object Location and Routing for Large-Scale Peer-to-Peer Systems
– Rowstron, Druschel
- 2001
|
|
813
|
Tapestry: An Infrastructure for Fault-Tolerant Wide-Area Location and Routing
– Zhao, Kubiatowicz, et al.
|
|
777
|
A measurement study of peer-topeer file sharing systems
– Saroiu, Gummadi, et al.
- 2002
|
|
614
|
Wide-Area Cooperative Storage with CFS
– Dabek, Kaashoek, et al.
- 2001
|
|
448
|
Epidemic algorithms for replicated database maintenance
– Demers, Greene, et al.
- 1987
|
|
386
|
Accessing Nearby Copies of Replicated Objects in a Distributed Environment
– Plaxton, Rajaraman, et al.
- 1997
|
|
283
|
Kademlia: A peer-to-peer information system based on the xor metric
– Maymounkov, Mazieres
- 2002
|
|
282
|
Tapestry: A Resilient GlobalScale Overlay for Service Deployment
– Zhao, Huang, et al.
- 2004
|
|
249
|
Measurement, Modeling, and Analysis of a Peer-to-Peer File-Sharing Workload
– Gummadi, Dunn, et al.
- 2003
|
|
222
|
Analyzing peer-to-peer traffic across large networks
– Sen, Wang
- 2004
|
|
189
|
Understanding availability
– Bhagwan, Savage, et al.
- 2003
|
|
181
|
The impact of DHT routing geometry on resilience and proximity
– Gummadi, Gummadi, et al.
- 2003
|
|
175
|
A quantitative comparison of graph-based models for internet topology
– Zegura, Calvert, et al.
- 1997
|
|
141
|
Analysis of the Evolution of the Peer-to-Peer Systems
– Liben-Nowell, Balakrishnan, et al.
- 2002
|
|
139
|
Distributed Object Location in a Dynamic Network
– Hildrum, Kubiatowicz, et al.
- 2002
|
|
133
|
Scalability and accuracy in a largescale network emulator
– Vahdat, Yocum, et al.
- 2002
|
|
111
|
Exploiting Network Proximity in Peer-to-Peer Overlay Networks
– Castro, Druschel, et al.
- 2002
|
|
103
|
Availability and locality measurements of peer-to-peer file systems
– Chu, Labonte, et al.
- 2002
|
|
94
|
An evaluation of scalable application-level multicast built using peer-to-peer overlays
– Castro, Jones, et al.
- 2003
|
|
93
|
Designing a DHT for Low Latency and High Throughput
– Dabek, Li, et al.
- 2004
|
|
83
|
availability, scalable storage, dynamic peer networks: Pick two
– BLAKE, RODRIGUES
- 2003
|
|
68
|
On spreading a rumor
– Pittel
|
|
58
|
Performance and Dependability of Structured Peer-to-Peer Overlays
– Castro, Costa, et al.
- 2004
|
|
57
|
Brocade: Landmark routing on overlay networks
– Zhao, Duan, et al.
- 2002
|
|
56
|
Controlling the cost of reliability in peer-to-peer overlays
– Mahajan, Castro, et al.
- 2003
|
|
53
|
Datagram Congestion Control Protocol Mobility and Multihoming,” draft-kohler-dccp-mobility-00.txt
– Kohler
|
|
47
|
The Case for a Hybrid P2P Search Infrastructure
– Loo, Huebsch, et al.
- 2004
|
|
43
|
Comparing the performance of distributed hash tables under churn
– Li, Stribling, et al.
- 2004
|
|
31
|
Robust and Efficient Data Management for a Distributed Hash Table
– Cates
- 2003
|
|
10
|
Learning Euclidean coordinates for Internet hosts. www.pdos.lcs.mit.edu/˜rsc/6867.pdf
– Cox, Dabek
- 2002
|
|
8
|
Building a flexible and efficient routing infrastructure: Need and challenges
– Lakshminarayanan, Stoica, et al.
- 2003
|
|
1
|
Measurement, modeling, and analysis of a peerto -peer file-sharing workload
– Gummadi, Dunn, et al.
- 2003
|