Pipeline and Batch Sharing in Grid Workloads (2003)
Cached
Download Links
| Venue: | In Proceedings of High-Performance Distributed Computing (HPDC-12 |
| Citations: | 33 - 11 self |
BibTeX
@INPROCEEDINGS{Thain03pipelineand,
author = {Douglas Thain and John Bent and Andrea C. Arpaci-dusseau and Remzi H. Arpaci-dusseau and Miron Livny},
title = {Pipeline and Batch Sharing in Grid Workloads},
booktitle = {In Proceedings of High-Performance Distributed Computing (HPDC-12},
year = {2003},
pages = {152--161}
}
Years of Citing Articles
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
We present a study of six batch-pipelined scientific workloads that are candidates for execution on computational grids. Whereas other studies focus on the behavior of single applications, this study characterizes workloads composed of pipelines of sequential processes that use file storage for communication and also share significant data across a batch. This study includes measurements of the memory, CPU, and I/O requirements of individual components as well as analyses of I/O sharing within complete batches. We conclude with a discussion of the ramifications of these workloads for end-to-end scalability and overall system design.
