Parallel I/O workload characteristics using Vesta (1995)
| Venue: | in Proceedings of the IPPS ’95 Workshop on Input/Output in Parallel and Distributed Systems, IEEE Computer Society |
| Citations: | 30 - 0 self |
BibTeX
@INPROCEEDINGS{Wu95paralleli/o,
author = {C. Eric Wu},
title = {Parallel I/O workload characteristics using Vesta},
booktitle = {in Proceedings of the IPPS ’95 Workshop on Input/Output in Parallel and Distributed Systems, IEEE Computer Society},
year = {1995},
pages = {16--29}
}
Years of Citing Articles
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
In recent years, the design and performance evaluation of parallel processors has focused on the processor, memory and communication subsystems. As a result, these subsystems have better performance potential than the I/O subsystem. In fact, the I/O subsystem is the bottleneck in many machines. However, there are a number of studies currently underway to improve the design of parallel I/O subsystems. To develop optimal parallel I/O subsystem designs, one must have a thorough understanding of the workload characteristics of parallel I/O and its exploitation of the associated parallel file system. Presented are the results of a study conducted to analyze the parallel I/O workloads of several applications on a parallel processor using the Vesta parallel file system. Traces of the applications are obtained to collect system events, communication events, and parallel I/O events. The traces are then analyzed to determine workload characteristics. The results show I/O request rates on the order of hundreds of requests per second, a large majority of requests are for small amounts of data (less than 1500 bytes), a few requests are for large amounts of data (on the order of megabytes), significant file sharing among processes within a job, and strong temporal, traditional spatial, and interprocess spatial locality. I.
Citations
| 399 | Measurements of a distributed file system - Baker, Hartman, et al. - 1991 |
| 96 | Input/output behavior of supercomputer applications - Miller, Katz - 1991 |
| 76 | Dynamic file-access characteristics of a production parallel scientific workload - Kotz, Nieuwejaar - 1994 |
| 28 | 4 parallel interleaved file system - Dibble - 1990 |
| 17 | A study of I/O behavior of perfect benchmarks on a multiprocessor - Reddy, Banerjee - 1990 |
| 13 | HFS: A Flexible File System for Large-Scale Multiprocessors - KRIEGER, STUMM - 1993 |
| 7 | RAMA: A File System for Massively-Parallel Computers - Miller, Katz - 1993 |
| 6 | A Static Analysis of - Pasquale, Polyzos - 1993 |
| 5 | High Performance I/O for Parallel Computers - Rosario, M, et al. - 1994 |
| 3 | Video on demand using the Vesta parallel file system - Kalns, Hsu - 1995 |
| 2 | Timestamp consistency and trace-driven analysis for distributed parallel systems - Wu, Liu, et al. - 1995 |
