Automatic Compiler-Inserted I/O Prefetching for Out-of-Core Applications

DMCA

Automatic Compiler-Inserted I/O Prefetching for Out-of-Core Applications (1996)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Todd C. Mowry , Angela K. Demke , Orran Krieger

Citations:

162 - 6 self

BibTeX

@MISC{Mowry96automaticcompiler-inserted,
    author = {Todd C. Mowry and Angela K. Demke and Orran Krieger},
    title = {Automatic Compiler-Inserted I/O Prefetching for Out-of-Core Applications},
    year = {1996}
}

OpenURL

Abstract

Current operating systems offer poor performance when a numeric application's working set does not fit in main memory. As a result, programmers who wish to solve "out-of-core" problems efficiently are typically faced with the onerous task of rewriting an application to use explicit I/O operations (e.g., read/write). In this paper, we propose and evaluate a fully-automatic technique which liberates the programmer from this task, provides high performance, and requires only minimal changes to current operating systems. In our scheme, the compiler provides the crucial information on future access patterns without burdening the programmer, the operating system supports non-binding prefetch and re- lease hints for managing I/O, and the operating sys- tem cooperates with a run-time layer to accelerate performance by adapting to dynamic behavior and minimizing prefetch overhead. This approach maintains the abstraction of unlimited virtual memory for the programmer, gives the compiler the flexibility to aggressively move prefetches back ahead of references, and gives the operating system the flexibility to arbitrate between the competing resource demands of multiple applications. We have implemented our scheme using the SUIF compiler and the Hurricane operating system. Our experimental results demonstrate that our fully-automatic scheme effectively hides the I/O latency in out-of- core versions of the entire NAS Parallel benchmark suite, thus resulting in speedups of roughly twofold for five of the eight applications, with one application speeding up by over threefold.

Keyphrases

out-of-core application automatic compiler-inserted operating system out-of core version prefetch overhead non-binding prefetch main memory re lease hint multiple application operating sys tem out-of-core problem hurricane operating system future access pattern suif compiler run-time layer fully-automatic technique high performance crucial information onerous task resource demand fully-automatic scheme numeric application read write minimal change entire na parallel benchmark suite poor performance experimental result unlimited virtual memory

DMCA