Handling Churn in a DHT

Handling Churn in a DHT (2004)

Cached

Download Links

by Sean Rhea , Dennis Geels , Timothy Roscoe , John Kubiatowicz

Venue:	In Proceedings of the USENIX Annual Technical Conference
Citations:	336 - 22 self

BibTeX

@INPROCEEDINGS{Rhea04handlingchurn,
    author = {Sean Rhea and Dennis Geels and Timothy Roscoe and John Kubiatowicz},
    title = {Handling Churn in a DHT},
    booktitle = {In Proceedings of the USENIX Annual Technical Conference},
    year = {2004}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

This paper addresses the problem of churn---the continuous process of node arrival and departure---in distributed hash tables (DHTs). We argue that DHTs should perform lookups quickly and consistently under churn rates at least as high as those observed in deployed P2P systems such as Kazaa. We then show through experiments on an emulated network that current DHT implementations cannot handle such churn rates. Next, we identify and explore three factors affecting DHT performance under churn: reactive versus periodic failure recovery, message timeout calculation, and proximity neighbor selection. We work in the context of a mature DHT implementation called Bamboo, using the ModelNet network emulator, which models in-network queuing, cross-traffic, and packet loss. These factors are typically missing in earlier simulationbased DHT studies, and we show that careful attention to them in Bamboo's design allows it to function effectively at churn rates at or higher than that observed in P2P file-sharing applications, while using lower maintenance bandwidth than other DHT implementations.

Citations

3445	H.: Chord: A scalable peer-to-peer lookup service for internet applications - Stoica, Morris, et al. - 2001
2677	A Scalable Content-Addressable Network - Ratnasamy, Handley, et al.
2262	Congestion avoidance and control - Jacobson - 1988
1692	Pastry: Scalable, Distributed Object Location and Routing for Large-Scale Peer-to-Peer Systems - Rowstron, Druschel - 2001
1034	A measurement study of peer-to-peer file sharing systems - Saroiu, Gummadi, et al. - 2002
1033	Tapestry: an infrastructure for fault-tolerant wide-area location and routing - Zhao, Kubiatowicz, et al. - 2001
842	Wide-Area cooperative storage with CFS - DABEK, KAASHOEK, et al. - 2001
700	D.Terry. Epidemic Algorithms for Replicated Database Maintenance - Demers, Hauser, et al. - 1987
548	D.: Kademlia: A peer-to-peer information system based on the xor metric - Maymounkov, Mazières - 2002
472	Accessing nearby copies of replicated objects in a distributed environment - Plaxton, Rajaraman, et al. - 1997
436	Tapestry: A resilient global-scale overlay for service deployment - Zhao, Huang, et al. - 2004
391	modeling, and analysis of a peer-to-peer file-sharing workload - Gummadi, Dunn, et al. - 2003
296	Analyzing peer-to-peer traffic across large networks - Sen, Wang - 2004
275	Understanding availability - Bhagwan, Savage, et al. - 2003
246	The impact of DHT routing geometry on resilience and proximity - Gummadi, Gummadi, et al.
244	Scalability and Accuracy in a Large-Scale Network Emulator - Vahdat, Yocum, et al. - 2002
222	A quantitative comparison of graph-based models for Internet topology - Zegura, Calvert, et al. - 1997
192	D.: Analysis of the evolution of peer-to-peer systems - Liben-Nowell, Balakrishnan, et al.
167	Distributed Object Location in a Dynamic Network - Hildrum, Kubatowicz, et al. - 2002
158	Designing a DHT for low latency and high throughput - Dabek, Li, et al.
136	An Evaluation of Scalable Application-level Multicast Built Using Peer-topeer overlays - Castro, Jones, et al. - 2003
135	High availability, scalable storage, dynamic peer networks: Pick two - Blake, Rodrigues - 2003
133	Availability and Locality Measurements of Peer-to-Peer File Systems - Chu, Labonte, et al. - 2002
128	Exploiting Network Proximity in Peer-to-Peer Overlay Networks - Castro, Druschel, et al. - 2002
123	On spreading a rumor - Pittel - 1987
90	Performance and dependability of structured peer-to-peer overlays - Castro, Costa, et al. - 2003
85	Datagram congestion control protocol (DCCP - Kohler, Handley, et al.
76	Brocade: Landmark Routing on Overlay Networks - Zhao, Duan, et al. - 2002
73	Controlling the Cost of Reliability in Peer-to-peer Overlays - Mahajan, Castro, et al. - 2003
71	The case for a hybrid P2P search infrastructure - Loo, Huebsch, et al. - 2004
62	M.F.: Comparing the performance of distributed hash tables under churn - Li, Stribling, et al. - 2004
42	Robust and Efficient Data Management for a Distributed Hash Table - Cates - 2003
10	Learning Euclidean coordinates for Internet hosts - Cox, Dabek - 2002
8	Building a flexible and efficient routing infrastructure: Need and challenges - Lakshminarayanan, Stoica, et al. - 2003
1	Measurement, modeling, and analysis of a peerto -peer file-sharing workload - Gummadi, Dunn, et al. - 2003