DMCA
Design and Implementation Tradeoffs for Wide-Area Resource Discovery (2005)
Cached
Download Links
| Venue: | In Proceedings of 14th IEEE Symposium on High Performance, Research Triangle Park |
| Citations: | 98 - 13 self |
BibTeX
@INPROCEEDINGS{Albrecht05designand,
author = {Jeannie Albrecht and David Oppenheimer and Amin Vahdat and David A. Patterson},
title = {Design and Implementation Tradeoffs for Wide-Area Resource Discovery},
booktitle = {In Proceedings of 14th IEEE Symposium on High Performance, Research Triangle Park},
year = {2005},
pages = {113--124},
publisher = {IEEE Computer Society}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
We describe the design and implementation of SWORD, a scalable resource discovery service for wide-area distributed systems. In contrast to previous systems, SWORD allows users to describe desired resources as a topology of interconnected groups with required intra-group, inter-group, and per-node characteristics, along with the utility that the application derives from specified ranges of metric values. This design gives users the flexibility to find geographically distributed resources for applications that are sensitive to both node and network characteristics, and allows the system to rank acceptable configurations based on their quality for that application. Rather than evaluating a single implementation of SWORD, we explore a variety of architectural designs that deliver the required functionality in a scalable and highly-available manner. We discuss the tradeoffs of using a centralized architecture as compared to a fully decentralized design to perform wide-area resource discovery. To summarize our results, we found that a centralized architecture based on 4-node server cluster sites at network peering facilities outperforms a decentralized DHT-based resource discovery infrastructure with respect to query latency for all but the smallest number of sites. However, although a centralized architecture shows significant promise in stable environments, we find that our decentralized implementation has acceptable performance and also benefits from the DHT’s self-healing properties in more volatile environments. We evaluate the advantages and disadvantages of centralized and distributed resource discovery architectures on 1000 hosts in emulation and on approximately 200 PlanetLab nodes spread across the Internet.
Keyphrases
wide-area resource discovery centralized architecture implementation tradeoff highly-available manner acceptable performance desired resource network characteristic per-node characteristic scalable resource discovery service single implementation acceptable configuration resource discovery interconnected group 4-node server cluster site metric value significant promise volatile environment required functionality planetlab node architectural design decentralized dht-based resource discovery infrastructure wide-area distributed system distributed resource previous system self-healing property stable environment
