Disk-directed I/O for MIMD Multiprocessors

Disk-directed I/O for MIMD Multiprocessors (1994)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by David Kotz

Citations:

217 - 18 self

BibTeX

@MISC{Kotz94disk-directedi/o,
    author = {David Kotz},
    title = {Disk-directed I/O for MIMD Multiprocessors},
    year = {1994}
}

Bookmark

OpenURL

Abstract

Many scientific applications that run on today’s multiprocessors, such as weather forecasting and seismic analysis, are bottlenecked by their file-I/O needs. Even if the multiprocessor is configured with sufficient I/O hardware, the file-system software often fails to provide the available bandwidth to the application. Although libraries and enhanced file-system interfaces can make a significant improvement, we believe that fundamental changes are needed in the file-server software. We propose a new technique, disk-directed I/O, to allow the disk servers to determine the flow of data for maximum performance. Our simulations show that tremendous performance gains are possible. Indeed, disk-directed I/O provided consistent high performance that was largely independent of data distribution, obtained up to 93 % of peak disk bandwidth, and was as much as 16 times faster than traditional parallel file systems.

Citations

929	Performance Fortran Forum. High Performance Fortran language specification, version 1.0 - High - 1993
781	The Art of Computer Systems Performance Analysis - Jain - 1991
675	A case for redundant arrays of inexpensive disks (raid - Patterson, Gibson, et al. - 1988
434	An introduction to disk drive modeling - Ruemmler, Wilkes - 1994
245	A trace-driven analysis of the UNIX 4.2 BSD file system - Ousterhout, Costa, et al. - 1985
221	Proteus: A high-performance parallel-architecture simulator - Brewer, Dellarocas, et al. - 1991
199	Disk Scheduling Revisited,” in - Seltzer, Chen, et al. - 1990
150	Parallel programming in Split-C - Culler, Dusseau, et al. - 1993
115	Improved parallel I/O via a two-phase run-time access strategy - Rosario, Bordawekar, et al. - 1993
100	Input-Output Characteristics of Scalable Parallel Applications - Crandall, Aydt, et al. - 1995
96	Input/output behavior of supercomputer applications - Miller, Katz - 1991
92	Fileaccess characteristics of parallel scientific workloads - Nieuwejaar, Kotz, et al. - 1996
90	A concurrent file system for a highly parallel mass storage subsystem - Pierce - 1989
82	The TickerTAIP Parallel RAID Architecture - Cao, Lim, et al. - 1993
76	Dynamic file-access characteristics of a production parallel scientific workload - Kotz, Nieuwejaar - 1994
73	Design and Evaluation of primitives for Parallel I/O - Bordawekar, Rosario, et al. - 1993
70	Tuning the performance of I/O intensive parallel applications - Acharya, Uysal, et al. - 1996
67	Passion: Optimized I/O for parallel applications - Thakur, Choudhary, et al. - 1996
61	The design and implementation of SOLAR, a portable library for scalable out-ofcore linear algebra computations - Toledo, Gustavson - 1996
58	Jovian: A framework for optimizing parallel I/O - Bennett, Bryant, et al. - 1994
53	A Detailed Simulation Model of the HP 97560 Disk Drive - Kotz, Toh, et al. - 1994
50	nCUBE parallel I/O software - DeBenedictis, JD - 1992
49	sfs: a parallel file system for the CM-5 - LoVerso, Isman, et al. - 1993
48	Integrating Theory and Practice in Parallel File Systems - Cormen, Kotz
44	Bridge: A High-Performance File System for Parallel Processors - Dibble, Scott, et al. - 1988
41	Performance of the iPSC/860 Concurrent File System", report num - NITZBERG - 1992
39	A static analysis of I/O characteristics of scientific applications in a production workload - Pasquale, Polyzos - 1993
38	Applications-driven parallel I/O - Galbreath, Gropp, et al. - 1993
38	A preprocessor for virtual-memory C - Cormen, Colvin - 1994
37	Design and Implementation of the VESTA Parallel File System - Corbett, Feitelson - 1994
36	Server-directed collective i/o in panda - Seamons, Chen, et al. - 1995
33	Low-level interfaces for high-level parallel I/O - Nieuwejaar, Kotz - 1995
30	A benchmark of NonStop SQL Release 2 demonstrating near-linear speedup and scaleup on large databases - Englert, Gray, et al. - 1990
30	Caching and writeback policies in parallel file systems - Kotz, Ellis - 1991
29	Dynamic I/O characterization of I/O intensive scientific applications - Pasquale, Polyzos - 1994
29	An efficient abstract interface for multidimensional array I/O - Seamons, Winslett - 1994
28	4 parallel interleaved file system - Dibble - 1990
28	Song Bac Toh, and Sriram Radhakrishnan, “A Detailed Simulation Model of the HP 97560 Disk Drive - Kotz - 1994
26	A trace-driven analysis of the unix 4.2bsd le system - Ousterhout, Costa, et al. - 1985
26	A concurrent le system for a highly parallel mass storage system - Pierce - 1989
24	CMMD I/O: A parallel Unix I/O - Best, Greenberg, et al. - 1993
21	Performance measurement of the Concurrent File System of the Intel iPSC/2 hypercube - French, Pratt, et al.
20	Unix file access and caching in a multicomputer environment - Roy - 1993
18	High Performance SQL Through Low-level System Integration - Borr, Putzolu - 1988
17	Compiler and Runtime Support for Out-of-Core HPF Programs - Thakur, Bordawekar, et al. - 1994
16	The Vesta parallel le system - Corbett, Feitelson - 1996
15	Language, compiler and parallel database support for I/O intensive applications - Brezany, Mueck, et al. - 1995
14	Overview of the mpi-io parallel i/o interface - Corbett, Fietelson, et al. - 1995
13	ENWRICH: a compute-processor write caching scheme for parallel le systems - Purakayastha, Ellis, et al. - 1996
12	Unix le access and caching in a multicomputer environment - Roy - 1993