• Documents
  • Authors
  • Tables
  • Other Seers ▼
    RefSeer AckSeer CollabSeer SeerSeer
  • Log in
  • Sign up
  • MetaCart

CiteSeerX logo

Advanced Search Include Citations
Advanced Search Include Citations | Disambiguate

Automatic Compiler-Inserted I/O Prefetching for Out-of-Core Applications (1996)

Cached

  • Download as a PDF
  •  
  • Download as a PS

Download Links

  • [www.pdl.cmu.edu]
  • [www.cs.cmu.edu]
  • [www.cs.toronto.edu]
  • [www.usenix.org]
  • [www.cs.columbia.edu]
  • [www.pdl.cmu.edu]
  • [www.pdl.cs.cmu.edu]
  • [www-2.cs.cmu.edu]
  • [www-2.cs.cmu.edu]
  • [cs.wisc.edu]
  • [www.cs.cmu.edu]

  • Other Repositories/Bibliography

  • DBLP
  • Save to List
  • Add to Collection
  • Correct Errors
  • Monitor Changes
by Todd C. Mowry , Angela K. Demke , Orran Krieger
Citations:138 - 6 self
  • Summary
  • Active Bibliography
  • Co-citation
  • Clustered Documents
  • Version History

BibTeX

@MISC{Mowry96automaticcompiler-inserted,
    author = {Todd C. Mowry and Angela K. Demke and Orran Krieger},
    title = {Automatic Compiler-Inserted I/O Prefetching for Out-of-Core Applications},
    year = {1996}
}

Bookmark

citeulike Connotea Bibsonomy Del.icio.us Digg Reddit

OpenURL

 

Abstract

Current operating systems offer poor performance when a numeric application's working set does not fit in main memory. As a result, programmers who wish to solve "out-of-core" problems efficiently are typically faced with the onerous task of rewriting an application to use explicit I/O operations (e.g., read/write). In this paper, we propose and evaluate a fully-automatic technique which liberates the programmer from this task, provides high performance, and requires only minimal changes to current operating systems. In our scheme, the compiler provides the crucial information on future access patterns without burdening the programmer, the operating system supports non-binding prefetch and re- lease hints for managing I/O, and the operating sys- tem cooperates with a run-time layer to accelerate performance by adapting to dynamic behavior and minimizing prefetch overhead. This approach maintains the abstraction of unlimited virtual memory for the programmer, gives the compiler the flexibility to aggressively move prefetches back ahead of references, and gives the operating system the flexibility to arbitrate between the competing resource demands of multiple applications. We have implemented our scheme using the SUIF compiler and the Hurricane operating system. Our experimental results demonstrate that our fully-automatic scheme effectively hides the I/O latency in out-of- core versions of the entire NAS Parallel benchmark suite, thus resulting in speedups of roughly twofold for five of the eight applications, with one application speeding up by over threefold.

Citations

521 The NAS parallel benchmarks - Bailey, Barszcz, et al. - 1991
450 Design and evaluation of a compiler algorithm for prefetching - Mowry, Lam, et al. - 1992
321 Informed prefetching and caching - Patterson, Gibson, et al. - 1995
282 RAID: high performance, reliable secondary storage - Chen, Lee, et al. - 1994
263 Tolerating Latency Through Software-Controlled Prefetching - Mowry, Gupta - 1991
226 Optimal prefetching via data compression - Vitter, Krishnan - 1991
170 Reducing file system latency using a predictive approach - Griffioen, Appleton - 1994
168 A Study of Integrated Prefetching and Caching Strategies‖, Measurement and Modeling of Computer Systems - Cao, Felten, et al. - 1995
123 Software Methods for Improvement of Cache Performance on Supercomputer Applications - Porterfield - 1989
122 D.S.: PPFS: A high performance portable parallel file system - Jr, Elford, et al. - 2001
100 Input-Output Characteristics of Scalable Parallel Applications - Crandall, Aydt, et al. - 1995
82 Predicting file system actions from prior events - Kroeger, Long - 1996
74 Prefetching in File Systems for MIMD Multiprocessors - Kotz, Ellis - 1990
73 Scalability in the XFS file system - Sweeney - 1996
66 Sharlit: A tool for building optimizers - Tjiangan, Hennessy - 1992
57 Hierarchical clustering: A structure for scalable multiprocessor operating system design - Unrau, Krieger, et al. - 1995
49 Hfs: A performance-oriented flexible file system based on building-block compositions - Krieger, Stumm - 1997
45 High-performance I/O for massively parallel computers --- problems and prospects - Rosario, Choudhary - 1994
45 Practical prefetching techniques for multiprocessor le systems - Kotz, Ellis - 1993
40 PASSION runtime library for parallel I/O - Thakur, Bordawekar, et al. - 1994
38 A preprocessor for virtual-memory C - Cormen, Colvin - 1994
34 The Hector Multiprocessor - Vranesic, Stumm, et al. - 1991
33 Preliminary Survey of I/O Intensive Applications. California Institute of Technology, Available at http://www.ccsf.caltech.edu/SIO/SIO.html - Poole - 1994
32 ELFS: Object-Oriented Extensible File Systems - Grimshaw, Jr, et al. - 1991
21 Compilation of out-of-core data parallel programs for distributed memory machines - Thakur, Bordawekar, et al. - 1994
19 Out of core, out of mind: Practical parallel i/o - Womble, Greenberg, et al.
18 Automatic optimization of communication in out-of-core stencil codes - Bordawekar, Choudhary, et al. - 1996
18 Compiler support for out-of-core arrays on data parallel machines - Paleczny, Kennedy, et al. - 1995
17 On the paging performance of array algorithms - Trivedi - 1977
12 A prefetching prototype for parallel file system on the Paragon. ACM Measurement and Modeling of Computer Systems - Arunachalam, Choudhary, et al. - 1995
11 ADOPT: A Dynamic Scheme for Optimal Prefetching in Parallel File Systems - Singh, Choudhary - 1994
8 Software Methods for Improvement of Cache Performance onSupercomputer Applications - eld - 1989
7 Scalable I/O for out-of-core structures - Kennedy, Koelbel, et al. - 1993
7 PPFS: a high performance portable parallel le system - Huber, Elford, et al. - 1995
6 Prefetching in le systems for MIMD multiprocessors - Kotz, Ellis - 1990
5 Compiler support for parallel I/O operations - Reddy, Banerjee, et al. - 1991
5 Reducing le system latency using a predictive approach - Griffioen, Appleton - 1994
5 ELFS: object-oriented extensible le systems - Grimshaw, Loyot - 1991
4 prefetching based on fault history - Page - 1993
4 Predicting le-system actions from prior events - Kroeger, Long - 1996
3 Compiler directed management policy for numerical programs - Malkawi, Patel - 1985
3 A prefetching prototype for the parallel le system on the Paragon - Arunachalam, Choudhary, et al. - 1995
3 HFS: A performance-oriented exible le system based on building-block compositions - Krieger, Stumm - 1996
2 ViC*: A preprocessor for virtual-memory C - COLVIN, CORMEN - 1998
1 A Study of Integrated Profetching and Caching Strategies - Cao, Fcltcn, et al. - 1995
1 Software Methods for hnprovemerit of Cache Performance on Supercomputer Applications - Porterfield - 1989
The National Science Foundation
  • About CiteSeerX
  • Submit Documents
  • Privacy Policy
  • Help
  • Data
  • Source
  • Contact Us

Developed at and hosted by The College of Information Sciences and Technology

© 2007-2010 The Pennsylvania State University