Results 1 - 10
of
67
Virtual Workspaces: Achieving Quality of Service and Quality
- of Life in the Grid. Scientific Programming Journal
, 2005
"... By defining standardized protocols for discovering, accessing, monitoring, and managing remote computers, storage systems, networks, and other resources, Grid technologies make it possible—in principle—to allocate resources to applications dynamically, in an on-demand fashion [1]. However, while Gri ..."
Abstract
-
Cited by 125 (17 self)
- Add to MetaCart
By defining standardized protocols for discovering, accessing, monitoring, and managing remote computers, storage systems, networks, and other resources, Grid technologies make it possible—in principle—to allocate resources to applications dynamically, in an on-demand fashion [1]. However, while Grids offer users access to many diverse and powerful resources, they do little to ensure that once a
Sharing Networked Resources with Brokered Leases
- In Proceedings of the USENIX Technical Conference
, 2006
"... This paper presents the design and implementation of Shirako, a system for on-demand leasing of shared networked resources. Shirako is a prototype of a serviceoriented architecture for resource providers and consumers to negotiate access to resources over time, arbitrated by brokers. It is based on ..."
Abstract
-
Cited by 102 (32 self)
- Add to MetaCart
(Show Context)
This paper presents the design and implementation of Shirako, a system for on-demand leasing of shared networked resources. Shirako is a prototype of a serviceoriented architecture for resource providers and consumers to negotiate access to resources over time, arbitrated by brokers. It is based on a general lease abstraction: a lease represents a contract for some quantity of a typed resource over an interval of time. Resource types have attributes that define their performance behavior and degree of isolation. Shirako decouples fundamental leasing mechanisms from resource allocation policies and the details of managing a specific resource or service. It offers an extensible interface for custom resource management policies and new resource types. We show how Shirako enables applications to lease groups of resources across multiple autonomous sites, adapt to the dynamics of resource competition and changing load, and guide configuration and deployment. Experiments with the prototype quantify the costs and scalability of the leasing mechanisms, and the impact of lease terms on fidelity and adaptation. 1
Scientific Cloud Computing: Early Definition and Experience
- In 10th IEEE International Conference on High Performance Computing and Communications
, 2008
"... 2.2 Functional aspects of Cloud computing. 3 ..."
(Show Context)
Vsched: Mixing batch and interactive virtual machines using periodic real-time scheduling
- In Proceedings of ACM/IEEE SC 2005 (Supercomputing
, 2005
"... We are developing Virtuoso, a system for distributed computing using virtual machines (VMs). Virtuoso must be able to mix batch and interactive VMs on the same physical hardware, while satisfying constraints on responsiveness and compute rates for each workload. VSched is the component of Virtuoso t ..."
Abstract
-
Cited by 72 (16 self)
- Add to MetaCart
(Show Context)
We are developing Virtuoso, a system for distributed computing using virtual machines (VMs). Virtuoso must be able to mix batch and interactive VMs on the same physical hardware, while satisfying constraints on responsiveness and compute rates for each workload. VSched is the component of Virtuoso that provides this capability. VSched is an entirely user-level tool that interacts with the stock Linux kernel running below any type-II virtual machine monitor to schedule all VMs (indeed, any process) using a periodic real-time scheduling model. This abstraction allows compute rate and responsiveness constraints to be straightforwardly described using a period and a slice within the period, and it allows for fast and simple admission control. This paper makes the case for periodic real-time scheduling for VM-based computing environments, and then describes and evaluates VSched. It also applies VSched to scheduling parallel workloads, showing that it can help a BSP application maintain a fixed stable performance despite externally caused load imbalance.
Virtual Clusters for Grid Communities
- In Proceedings of the Sixth International Symposium on Cluster Computing and Grid (CCGRID
, 2006
"... A challenging issue facing Grid communities is that while Grids can provide access to many heterogeneous resources, the resources to which access is provided often do not match the needs of a specific application or service. In an environment in which both resource availability and software requirem ..."
Abstract
-
Cited by 70 (2 self)
- Add to MetaCart
(Show Context)
A challenging issue facing Grid communities is that while Grids can provide access to many heterogeneous resources, the resources to which access is provided often do not match the needs of a specific application or service. In an environment in which both resource availability and software requirements evolve rapidly, this disconnect can lead to resource underutilization, user frustration, and much wasted effort spent on bridging the gap between applications and resources. We show here how these issues can be overcome by allowing authorized Grid clients to negotiate the creation of virtual clusters made up of virtual machines configured to suit client requirements for software environment and hardware allocation. We introduce descriptions and methods that allow us to deploy flexibly configured virtual cluster workspaces. We describe their configuration, implementation, and evaluate them in the context of a virtual cluster representing the environment in production use by the Open Science Grid. Our performance evaluation results show that virtual clusters representing current Grid production environments can be deployed and managed efficiently, and thus can provide an acceptable platform for Grid applications.
Recording and using provenance in a protein compressibility experiment
- In HPDC’05
, 2005
"... Very large scale computations are now becoming routinely used as a metliodology to undertake scientific research. In this context,)provenance systems ’ are regarded as the equivazent of the scientist’s logbook far in silico experimenlation: provenance captures the documentation of the process that l ..."
Abstract
-
Cited by 53 (15 self)
- Add to MetaCart
(Show Context)
Very large scale computations are now becoming routinely used as a metliodology to undertake scientific research. In this context,)provenance systems ’ are regarded as the equivazent of the scientist’s logbook far in silico experimenlation: provenance captures the documentation of the process that led to some result. Using a protein compressibility analysis application, we derive a set of generic use cascs for Q provenance system. In order to support these, we address the following fundamental questions: what is provenance? how to record il? what is the performance impacr for grid execution? what is the performance of reasoning? In doing so, we dejne a technologyindependent notion of provenance that captures intemctions between components, internal componenr information and grouping of interactions, so as to allow us to analyse and reason about rhe execution of scientific processes. In order to siipport persistennl provenance in heterogeneous upplications, we introduce a separate provenance store, in which provenance documentation can be stored, archived and queried indepsndently of the technology used to mn the application. Through a series of practical tests, we evaluale the pe~onnance impact of such a provenance system. In summary, we demonstrate that provenance recording overhead of our protolype system remains under 10 % of execution rime, and we show that the recorded information successfully supports our use cases in U perjbmant mannel: 1
Increasing Application Performance in Virtual Environments through Run-time Inference and Adaptation
- In Proceedings of the 14th IEEE International Symposium on High Performance Distributed Computing (HPDC
, 2005
"... Virtual machine distributed computing greatly simplifies the use of widespread computing resources by lowering the level of abstraction, benefiting both resource providers and users. Towards that end our Virtuoso middleware closely emulates the existing process of buying, configuring and using physi ..."
Abstract
-
Cited by 38 (14 self)
- Add to MetaCart
(Show Context)
Virtual machine distributed computing greatly simplifies the use of widespread computing resources by lowering the level of abstraction, benefiting both resource providers and users. Towards that end our Virtuoso middleware closely emulates the existing process of buying, configuring and using physical machines. Virtuoso's VNET component is a simple and efficient layer two virtual network tool that makes these virtual machines (VMs) appear to be physically connected to the home network of the user while simultaneously supporting arbitrary topologies and routing among them. Virtuoso's VTTIF component continually infers the communication behavior of the application running in a collection of VMs. The combination of overlays like VNET and inference frameworks like VTTIF has great potential to increase the performance, with no user or developer involvement, of existing, unmodified applications by adapting their virtual environments to the underlying computing infrastructure to best suit the applications. We show here how to use the continually inferred application topology and traffic to dynamically control three mechanisms of adaptation, VM migration, overlay topology, and forwarding to significantly increase the performance of two classes of applications, bulk synchronous parallel applications and transactional web ecommerce applications.
Toward a doctrine of containment: Grid hosting with adaptive resource control
- in 19th Annual Supercomputing Conference (SC ’06
, 2006
"... Abstract Grid computing environments need secure resource control and predictable service quality in order to be sustainable. We propose a grid hosting model in which independent, selfcontained grid deployments run within isolated containers on shared resource provider sites. Sites and hosted grids ..."
Abstract
-
Cited by 36 (13 self)
- Add to MetaCart
(Show Context)
Abstract Grid computing environments need secure resource control and predictable service quality in order to be sustainable. We propose a grid hosting model in which independent, selfcontained grid deployments run within isolated containers on shared resource provider sites. Sites and hosted grids interact via an underlying resource control plane to manage a dynamic binding of computational resources to containers. We present a prototype grid hosting system, in which a set of independent Globus grids share a network of cluster sites. Each grid instance runs a coordinator that leases and configures cluster resources for its grid on demand. Experiments demonstrate adaptive provisioning of cluster resources and contrast job-level and container-level resource management in the context of two grid application managers.
PReServ: Provenance recording for services
- in Proc. AHM’05
"... The importance of understanding the process by which a result was generated in an experiment is fundamental to science. Without such information, other scientists cannot replicate, validate, or duplicate an experiment. We define provenance as the process that led to a result. With large scale in-sil ..."
Abstract
-
Cited by 26 (7 self)
- Add to MetaCart
(Show Context)
The importance of understanding the process by which a result was generated in an experiment is fundamental to science. Without such information, other scientists cannot replicate, validate, or duplicate an experiment. We define provenance as the process that led to a result. With large scale in-silico experiments, it becomes increasingly difficult for scientists to record process documentation that can be used to retrieve the provenance of a result. Provenance Recording for Services (PReServ) is a software package that allows developers to integrate process documentation recording into their applications. PReServ has been used by several applications and its performance has been benchmarked. 1
Deploying virtual machines as sandboxes for the grid
- In Second Workshop on Real, Large Distributed Systems (WORLDS 2005
, 2005
"... The ability to securely run arbitrary untrusted code on a wide variety of execution platforms is a challenging problem in the Grid community. One way to achieve this is to run the code inside a contained, isolated environment, namely a “sandbox”. Virtual machines provide a natural solution to the se ..."
Abstract
-
Cited by 26 (1 self)
- Add to MetaCart
The ability to securely run arbitrary untrusted code on a wide variety of execution platforms is a challenging problem in the Grid community. One way to achieve this is to run the code inside a contained, isolated environment, namely a “sandbox”. Virtual machines provide a natural solution to the security and resource management issues that arise in sandboxing. We explore different designs for the VM-enabled sandbox and evaluate them with respect to various factors like structure, security guarantees, user convenience, feasibility and overheads in one such grid environment. Our experiments indicate that the use of ondemand VMs imposes a constant startup overhead, with I/O-intensive applications incurring additional overheads depending on the design of the sandbox. 1
