Resource location (or discovery) is a fundamental service for resource-sharing environments: given desired resource attributes, the service returns locations of matching resources. Designing such a service for a Grid environment of the scale and volatility of today's peer-to-peer systems is not trivial. We explore part of the design space through simulations on an emulated Grid. To this end, we propose four axes that define the resource location design space, model and implement an emulated Grid, evaluate a set of resource discovery mechanisms, and discuss results.
|
2394
|
Chord: A scalable peer-to-peer lookup service for Internet applications
– Stoica, Morris, et al.
- 2001
|
|
1950
|
A scalable Content-Addressable Network
– Ratnasamy, Francis, et al.
- 2001
|
|
1331
|
S.Tuecke, ‘‘The anatomy of the grid: Enabling scalable virtual organizations
– Foster, Kesselman
- 2001
|
|
1082
|
The Grid: Blueprint for a New Computing Infrastructure
– Foster, Kesselman, et al.
- 1999
|
|
855
|
Pastry: Scalable, decentralized object location, and routing for large-scale peer-to-peer systems
– Rowstron, Druschel
- 2001
|
|
840
|
Condor - a hunter of idle workstations
– Litzkow, Livny, et al.
- 1988
|
|
829
|
Emergence of scaling in random networks
– Barabasi, Albert
- 1999
|
|
812
|
Tapestry: An infrastructure for fault-tolerant wide-area location and routing
– Zhao, Kubiatowicz, et al.
- 2001
|
|
773
|
A measurement study of peer-to-peer file sharing systems
– Saroiu, Gummadi, et al.
- 2002
|
|
702
|
Oceanstore: An architecture for global-scale persistent storage
– Kubiatowicz, Bindel, et al.
- 2000
|
|
674
|
Freenet: A distributed anonymous information storage and retrieval system
– Clarke, Sandberg, et al.
- 2000
|
|
599
|
Web Caching and Zipf-Like Distributions: Evidence and Implications
– Breslau, Cao, et al.
- 1999
|
|
478
|
Statistical mechanics of complex networks
– Albert, Barabási
- 2002
|
|
426
|
Grid information services for distributed resource sharing
– Fitzgerald
|
|
386
|
Accessing nearby copies of replicated objects in a distributed environment
– Plaxton, Rajaraman, et al.
- 1997
|
|
356
|
Free riding on Gnutella
– Adar, Huberman
|
|
351
|
Search and replication in unstructured peer-to-peer networks
– Lv, Cao, et al.
- 2002
|
|
337
|
The small world phenomenon: an algorithmic perspective
– Kleinberg
- 1999
|
|
308
|
Small Worlds: The dynamics of networks between order and randomness
– Watts
- 1998
|
|
251
|
Matchmaking: Distributed Resource Management for High Throughput Computing
– Raman, Livny, et al.
- 1998
|
|
203
|
Mapping the Gnutella network: properties of large-scale peer-to-peer systems and implications for system design
– Ripeanu, Foster, et al.
- 2002
|
|
175
|
Linked: A New Science of Networks
– Barabasi
- 2002
|
|
174
|
Tapestry: An infrastructure for fault-resilient wide-area location and routing
– Zhao, Kubiatowicz, et al.
- 2001
|
|
171
|
SETI@home: An experiment in public-resource computing
– Anderson, Cobb, et al.
|
|
160
|
Efficient content location using interest-based locality in peer-to-peer systems
– Sripanidkulchai, Maggs, et al.
- 2003
|
|
156
|
Replication strategies in unstructured peer-to-peer networks
– Cohen, Shenker
- 2002
|
|
154
|
2001, ‘The Ninja Architecture for Robust Internet-Scale Systems and Services
– Gribble, Welsh, et al.
|
|
139
|
Search in power law networks
– Adamic, Lukose, et al.
- 2001
|
|
129
|
A better model for generating test networks
– Doar
- 1996
|
|
128
|
Scalable, distributed data structures for Internet service construction
– Gribble, Brewer, et al.
- 2000
|
|
126
|
On the Impossibility of Group Membership
– Chandra, Hadzilacos, et al.
- 1996
|
|
96
|
Decoupling computation and data scheduling in distributed data-intensive applications
– Ranganathan, Foster
|
|
85
|
On death, taxes, and the convergence of peer-to-peer and grid computing
– Foster, Iamnitchi
|
|
66
|
Scheduling distributed applications: The SimGrid simulation framework
– Legrand, Marchal, et al.
- 2003
|
|
59
|
On Fully Decentralized Resource Discovery in Grid Environments
– Iamnitchi, Foster
- 2001
|
|
51
|
Experiences Deploying a Large-Scale Emergent Network
– Wilcox-O’Hearn
- 2002
|
|
46
|
Group membership in the epidemic style
– Golding, Taylor
- 1992
|
|
44
|
J.Linderoth. Solving large quadratic assignment problems on computational grids
– Anstreicher, Brixius, et al.
- 2002
|
|
39
|
Domain names---concepts and facilities
– Mockapetris
- 1987
|
|
29
|
Locating data in (small-world?) peer-to-peer scientific collaborations
– Iamnitchi, Ripeanu, et al.
- 2002
|
|
22
|
2002. The Worldwide Computer
– ANDERSON, KUBIATOWICZ
|
|
22
|
Development of web toolkits for computational science portals: The npaci hotpage
– Thomas, Mock, et al.
- 2000
|
|
18
|
Scalable naming in global middleware
– Ballintijn, Steen
- 1999
|
|
13
|
Deterministic distributed resource discovery
– Kutten, Peleg
- 2000
|
|
10
|
NEESgrid: A Distributed Virtual Laboratory for Advanced Earthquake Experimentation and Simulation: Scoping Study
– Prudhomme, Kesselman, et al.
- 2001
|
|
6
|
et al.. Applying chimera virtual data concepts to cluster finding in the sloan sky survey
– Annis
- 2002
|
|
6
|
Globe: AWide-Area Distributed System
– Steen, Homburg, et al.
- 1999
|
|
5
|
An explorative approach to federated trading
– Lee, Benford
- 1998
|
|
3
|
What is p2p... and what isn’t? http://www.openp2p.com/pub/a/p2p/2000/11/24/shirky1whatisp2p.html
– Shirky
- 2000
|
|
2
|
Myth and reality: Usage patterns in a large data-intensive physics project
– Iamnitchi, Ripeanu
- 2003
|