Despite interest in structured peer-to-peer overlays and their scalability to millions of nodes, few, if any, overlays operate at that scale. This paper considers the distributed hash table extensions supported by modern BitTorrent clients, which implement a Kademlia-style structured overlay network among millions of BitTorrent users. As there are two disjoint Kademlia-based DHTs in use, we collected two weeks of traces from each DHT. We examine churn, reachability, latency, and liveness of nodes in these overlays, and identify a variety of problems, such as median lookup times of over a minute. We show that Kademlia’s choice of iterative routing and its lack of a preferential refresh of its local neighborhood cause correctness problems and poor performance. We also identify implementation bugs, design issues, and security concerns that limit the effectiveness of these DHTs and we offer possible solutions for their improvement. 1
|
1302
|
Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems
– Rowstron, Druschel
- 2001
|
|
789
|
S.: A measurement study of peer-to-peer file sharing systems
– Saroiu, Gummadi, et al.
- 2002
|
|
586
|
The sybil attack
– Douceur
- 2002
|
|
423
|
Incentives Build Robustness in BitTorrent
– Cohen
- 2003
|
|
364
|
Free riding on gnutella
– Adar, Huberman
- 2000
|
|
361
|
Predicting internet network distance with coordinates-based approaches
– Ng, Zhang
- 2002
|
|
298
|
Kademlia: A Peer-to-Peer Information System Based on the XOR Metric
– Maymounkov, Mazieres
- 2002
|
|
256
|
Measurement, modeling, and analysis of a peer-to-peer file sharing workload
– Gummadi, Dunn, et al.
- 2003
|
|
241
|
Vivaldi: a decentralized network coordinate system
– Dabek, Cox, et al.
|
|
237
|
Topologyaware routing in structured peer-to-peer overlay networks
– Castro, Druschel, et al.
- 2002
|
|
217
|
Handling churn in a dht
– Rhea, Geels, et al.
- 2004
|
|
209
|
Modeling and Performance Analysis of BitTorrent-like Peer-to-Peer Networks
– Qiu, Srikant
- 2004
|
|
182
|
The impact of DHT routing geometry on resilience and proximity
– Gummadi, Gummadi, et al.
|
|
152
|
PlanetLab: an overlay testbed for broad-coverage services
– Chun, Culler, et al.
|
|
152
|
Dissecting BitTorrent: Five months in a torrent’s lifetime
– Izal, Urvoy-keller, et al.
- 2004
|
|
108
|
The bittorrent p2p file-sharing system: measurements and analysis
– Pouwelse, Garbacki, et al.
- 2005
|
|
107
|
Robust incentive techniques for peer-to-peer networks
– Feldman, Lai, et al.
- 2004
|
|
103
|
OpenDHT: A public DHT service and its uses
– Rhea, Godfrey, et al.
|
|
100
|
Estimating Latency between Arbitrary Internet End Hosts. Internet Measurement Conference
– King
- 2002
|
|
86
|
Samsara: Honor among thieves in peer-to-peer storage
– Cox, Noble
- 2003
|
|
85
|
Measuring and analyzing the characteristics of Napster and Gnutella hosts
– Saroiu, Gummadi, et al.
|
|
62
|
TCP Nice: A Mechanism for Background Transfers
– Venkataramani, Kokku, et al.
- 2002
|
|
59
|
Performance and dependability of structured peer-to-peer overlays
– Castro, Costa, et al.
- 2003
|
|
53
|
An Experimental Study of the Skype Peer-to-Peer VoIP System
– Guha, Daswani, et al.
- 2006
|
|
51
|
Analyzing and improving a bittorrent network’s performance mechanisms
– Bharambe, Herley, et al.
- 2006
|
|
45
|
A performance vs. cost framework for evaluating DHT design tradeoffs under churn
– Li, Stribling, et al.
|
|
42
|
Rarest first and choke algorithms are enough
– Legout, Urvoy-Keller, et al.
- 2006
|
|
40
|
Survey of Research towards Robust Peer-to-Peer Networks: Search Methods
– Risson, Moors
|
|
39
|
Incentives in BitTorrent induce free riding
– Jun, Ahamad
- 2005
|
|
36
|
The kazaa overlay: A measurement study
– Liang, Kumar, et al.
- 2005
|
|
33
|
Do incentives build robustness in BitTorrent
– Piatek, Isdal, et al.
- 2007
|
|
25
|
Strategyproof computing: Systems infrastructures for self-interested parties
– Ng, Parkes, et al.
- 2003
|
|
22
|
Fixing the embarrassing slowness of OpenDHT on PlanetLab
– RHEA, CHUN, et al.
|
|
20
|
Understanding BitTorrent: An Experimental Perspective, 2005. INRIA, INRIA-00000156, VERSION 3. Available at: http://hal.inria.fr/inria00000156/en 35
– Legout, Urvoy-Keller, et al.
|
|
20
|
Free riding in BitTorrent is cheap
– Locher, Moor, et al.
- 2006
|
|
15
|
Overcoming free-riding behavior in peer-to-peer systems
– Feldman, Chuang
- 2005
|
|
14
|
Opportunistic Measurement: Extracting Insight from Spurious Traffic
– Casado, Garfinkel, et al.
- 2005
|
|
14
|
modeling of bitTorrent-like systems
– Measurements
- 2005
|
|
12
|
Economic behavior of peer-to-peer storage networks
– Fuqua, Ngan, et al.
- 2003
|
|
9
|
The Effect of Heterogeneous Link Capacities in BitTorrent-Like File Sharing Systems
– Piccolo, Neglia, et al.
- 2004
|
|
7
|
Fallacies in evaluating decentralized systems
– Haeberlen, Mislove, et al.
- 2006
|
|
6
|
F.: Silver needle in the skype
– Biondi, Desclaux
|
|
5
|
Induced churn as shelter from routing table poisoning
– Condie, Kacholia, et al.
- 2006
|
|
5
|
Exploring tradeoffs in failure detection in routing overlays
– Zhuang, Stoica, et al.
- 2003
|
|
3
|
Enforcing routing consistency in structured peer-to-peer overlays: Should we and could we
– Chen, Liu
- 2006
|
|
3
|
Really truly trackerless bittorrent
– Fry, Reiter
- 2006
|
|
2
|
On the impact of dynamic addressing on malware propagation
– Rajab, Monrose, et al.
- 2006
|
