The Design and Implementation of a Log-Structured File System

The Design and Implementation of a Log-Structured File System (1991)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Mendel Rosenblum , John K. Ousterhout

Venue:	ACM TRANSACTIONS ON COMPUTER SYSTEMS
Citations:	808 - 6 self

BibTeX

@ARTICLE{Rosenblum91thedesign,
    author = {Mendel Rosenblum and John K. Ousterhout},
    title = {The Design and Implementation of a Log-Structured File System},
    journal = {ACM TRANSACTIONS ON COMPUTER SYSTEMS},
    year = {1991},
    volume = {10},
    pages = {1--15}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

This paper presents a new technique for disk storage management called a log-structured file system. A logstructured file system writes all modifications to disk sequentially in a log-like structure, thereby speeding up both file writing and crash recovery. The log is the only structure on disk; it contains indexing information so that files can be read back from the log efficiently. In order to maintain large free areas on disk for fast writing, we divide the log into segments and use a segment cleaner to compress the live information from heavily fragmented segments. We present a series of simulations that demonstrate the efficiency of a simple cleaning policy based on cost and benefit. We have implemented a prototype logstructured file system called Sprite LFS; it outperforms current Unix file systems by an order of magnitude for small-file writes while matching or exceeding Unix performance for reads and large writes. Even when the overhead for cleaning is included, Sprite LFS can ...

Citations

476	Fabry.Afast file system for UNIX - McKusick, Joy, et al. - 1984
408	Design and implementation of the sun network filesystem - Sandberg, Golgberg, et al.
399	Measurements of a distributed file system - Baker, Hartman, et al. - 1991
288	Why aren't operating systems getting faster as fast as hardware - Ousterhout - 1990
258	The Sprite network operating system - Ousterhout, Cherenson, et al. - 1988
249	Katz “A case for redundant arrays of inexpensive disks - Patterson, Gibson, et al. - 1988
245	A trace-driven analysis of the UNIX 4.2 BSD file system - Ousterhout, Costa, et al. - 1985
234	A Real-Time Garbage Collector Based on the Lifetime of Objects - Lieberman, Hewitt - 1983
202	List processing in real time on a serial computer - Baker - 1978
199	Disk Scheduling Revisited,” in - Seltzer, Chen, et al. - 1990
191	Notes on Data Base Operating Systems - Gray - 1978
136	Reimplementing the Cedar File System Using Logging and Group Commit - Hagmann - 1987
120	Extent-like Performance from a UNIX File System - McVoy, Kleiman - 1991
77	A Study of File Sizes and Functional Lifetimes - Satyanarayanan - 1981
55	Katz: A Case for Redundant - Patterson, Gibson, et al. - 1988
51	File Access Performance of Diskless Workstations - Lazowska, Zahorjan, et al. - 1986
50	A crash recovery scheme for memory-resident database system - Hagmann - 1986
38	Swallow: a distributed data storage system for a local network - Reed, Svobodova - 1980
29	Notes on Data Base Operating Systems, Operating Systems, An Advanced Course - Gray - 1978
25	Log files: An extended file service exploiting write-once storage - Finlayson, Cheriton - 1987
21	Reliable object storage to support atomic actions - Oki, Liskov, et al. - 1985
12	Fsck - the unix file system check program - McKusick, Joy, et al. - 1986
9	Evolution of storage facilities - Chang, Mergen, et al. - 1990
6	A Study of File Sizes and Functional - Satyanarayanan - 1981
5	List Processing in Real Time on a - Baker - 1977
4	A Case for Redundant Arrays of Inexpensive Disks - Peterson, Katz - 1988
4	Ousterhout: Measurements of a distributed file system - Kupfer
4	Implementation techniques for main memory database systems - Wood - 1984
4	Crash Recovery Mechanisms for Main Storage Database Systems - Salem, Garcia-Molina - 1986
3	A case for redundant arrays of inexpensive disks (RAID - Katz - 1988
2	Disk scheduling revisited - Ousterhout - 1990
2	Reliable Object Storage to Support Atomic Actions - Scheifler - 1985
1	Fsck - The UNIX File System - Leffler, Fabry - 1986
1	Reliable Object Storage to Support 22 - Oki, Liskov, et al. - 1983
1	Implementation Techniques for Main Memory 23 - DeWitt, Katz, et al. - 1985
1	R Cheriton, and Winy Zwaenepoel, “File Access Performance of Diskless Workstations - Lazowska, Zahorjan, et al. - 1986
1	Implementation techniques for main memory database systems - D, STONEBRAKERM, et al. - 1984
1	Decorum file system architectural overview - IDES, BOTTOS, et al. - 1990
1	Ousterhout 17 - Rosenblum, K - 1992
1	Crash recovery mechamsms for main storage database systems - SALEM, LINA, et al. - 1986